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1 , Sunun^^y 

1.1.  Mathematical  semantics  is  introduced  as  the  study  of 

< ' — ■ ■ 

mappings  between  configuration  spaces  and  image  algebras. 

1.2.  An  image  algebra  is  synthesized  using  generators 

that  are  relations.  This  will  serve  as  the  semantic  counterpart 
of  a formal  language.  The  image  algebra  is  analyzed  in  terms  of 
its  similarity  group,  bond  relations  and  connection  type. 

1.3.  The  semantic  map  is  studied  in  terms  of  the  morphisms 
of  a category,  the  term  used  in  its  algebraic  sense. 

1.4.  We  present  strategies  for  constructing  semantic  maps 
with  special  properties  related  to  memory  requirements. 

1.5.  Some  examples  are  jiven,  showing  how  the  semantic 
categories  can  be  constructed. 
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2 . Introducing  mathematical  semantics. 

2.1.1.  Can  mathematics  contribute  anything  to  the  study  of 
semantics  and  to  the  study  of  how  semantics  is  learned  (should 
be  learned)  by  man  (machines)?  The  word  semantics  is  of  fairly 
recent  origin,  dating  bac)c  to  the  XIX  century,  but  the  subject 
itself  goes  bac)c  to  the  beginnings  of  philosophy.  Most  of  the 
major  figures  in  the  history  of  philosophy  devoted  some  of  their 
thin)cing  to  the  relation  between  words,  sentences,  grammar,  and 
language,  on  the  one  hand,  with  phenomena  in  the  real  world  on  the  other. 

Such  studies  have  traditionally  been  carried  out  by 
informal  means  and  involved  no  explicit  use  of  mathematics. 

2.1.2.  More  recently  attempts  have  been  made  to  formalize 
semantic  ideas,  which  can  be  seen  in  two  disciplines,  linguistics 
and  computer  science.  In  formal  linguistics  this  seems  to  have 
been  started  at  about  the  same  time  as  when  the  study  of  syntax 
was  formalized  during  the  1960's.  The  earliest  reference  that 

we  are  aware  of  is  Katz-Fodor  (1963) , where  syntactic  structures 
were  transformed  into  what  has  become  Icnow  as  K-F  trees.  The 
K-F  trees  are  formal  constructs  attributing  meaning  to  linguistic 
utterances . 

Linguists  have  continued  along  this  avenue  of  approach,  which  has 
resulted  in  a large  literature.  An  important  idea  in  this 
literature  is  the  semantic  net  which  has  been  applied  many  times. 

One  has  typically  talten  a subset  of  a natural  language,  usually 
English,  and  tried  to  formalize  its  semantics  by  a computer 
program.  In  this  way  one  would  hope  that  the  logical  discipline 
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and  precision  required  when  writing  the  program  would  bring  out 
the  basic  difficulties  clearly.  An  important  contribution  can 
be  found  in  Woods  (1970).  The  interested  reader  will  find  an 
up-to-date  presentation  of  this  approach  in  Simmons  (1973). 

2.1.3.  These  endeavors  overlap  to  a considerable  extent 
with  work  done  in  artificial  intelligence,  although  the  emphasis 
differs.  In  the  latter  the  cjoal  is  often  to  build  a question- 
an.swer  program  for  some  sufficiently  narrow  domain  of  discourse. 
The  celebrated  work  by  Winograd  (1972)  belongs  in  this  group. 

The  many  attempts  that  have  been  made  in  this  direction 
aim  at,  not  just  a computer  program,  sometimes  possibly  of 
utilitarian  value,  but  insight  and  understanding  of  semantic 
structures.  In  spite  of  skeptical  comments  to  the  contrary  we 
believe  that  these  efforts  have  indeed  led  to  an  increased 
understanding . 

2.1.4.  As  far  as  we  know  mathematical  formalization  has 
not  been  employed  except  in  a few  publications.  One  is  in 
I.andewall  (1971),  where  the  mathematical  tool  is  predicate 
calculus. 

In  1977  the  author  together  with  P.  Wegner  organized  a 
seminar  series  in  formal  semantics  at  Brown  University.  During 
this  series  the  voluminous  literature  was  surveyed,  most  of  it 
from  the  linguistic  and  computer  science  journals.  Formaliza- 
tion in  mathematical  terms  seems  to  have  been  attempted  only 
sporadically,  and  we  came  across  little  of  mathematical  content. 
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One  reason  why  mathematics  has  been  used  so  little  is 
probably  that  no  mathematical  theory  has  been  generally  available 
for  the  analysis  of  semantic  structures.  We  believe  that  pattern 
theory,  as  presented  in  Grenander  (1976,  1978),  offers  a tool 
suitable  for  this  purpose.  The  present  paper  is  a continuation 
of  worlt  begun  in  the  latter  reference,  section  2.4. 

In  particular  we  shall  attempt  to  show  that  mathematical 
semantics  can  be  expressed  in  terms  of  mappings  of  configuration 
spaces  and  image  algebras.  Such  mappings  are  fundamental  to 
pattern  theory,  just  as  morphisms  are  fundamental  in  algebra 
in  general. 

2.2.1.  Our  perspective  is  conformal  to  that  of  the  early 
Wittgenstein  in  his  Tractatjjs  Logico-Philosophicus , except, 
of  course,  that  we  shall  proceed  in  a mathematical  formalized 
manner.  Let  us  remind  the  reader  of  Wittgenstein's  view  of 
the  issues  that  will  concern  us  here.  Some  of  his  aphorisms 
have  been  reproduced  in  an  Appendix. 

Wittgenstein  is  often  as  obscure  as  he  is  thought  provolcing, 
perhaps  intentionally.  When  he  speaks  of  "things"  for  example, 
it  is  not  clear  if  these  are  material  objects  or,  say,  sensory 
data . 

The  following  interpretation  is  strongly  influenced  by 
Wedberg  (1966),  Chapter  V,  and  von  Wright  (1957),  pp. 134-154. 

2.2.2.  The  world  consists  of  facts,  Tl,l-l,12  (this  refers 
to  the  numbered  sections  of  Tractatus) . A fact  is  a collection 
of  things  related  to  each  other,  T2.0272,  2.031.  The  thing? 
make  up  the  substance  of  the  world,  T2.021. 
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Somi'  facts  can  be  seen  to  bt*  made  up  from  other  facts, 
others  cannot  be  sf’lit  up.  The  latter  are  the  atomic  facts. 

2.2.  i.  Let  us  denote  the  set  of  thinqs  by  T and  corisider 
a set  O of  operations.  The  operations  act  upon  thinqs  anil 
produce  simple  facts.  An  operation  can  operate  on  just  one 
thinq,  or  two  thinqs,  and  so  on.  It  is  a function  with,  say, 
n places  (or  arquments) . 

When  we  apply  all  operators  to  all  combinations  of  thinqs 
we  qet  the  set  S of  atomic  facts.  Wittqenstein  probably  does 
not  assume  that  an  operator  with  n places  can  be  applied  to 
any  combination  of  n thinqs.  If  this  is  so  the  operations  are 
partial  functions. 

Another  set  U of  operations  actsupon  atomic  facts,  from  S, 
and  results  in  composite  facts.  The  set  F of  all  such  facts 
is  the  ontoloqical  base  for  underst and i nq  the  world. 

2.2.4.  Of  course  Wittqenstein  did  not  formalize  his 
thinkinq  in  this  way,  perhaps  he  would  bo  opposed  to  any 
formalization  attempt.  It  would  be  too  precise  losinq  the 
"mu  1 1 i -d imens iona 1 " amb iqu i t y . 

2.2.5.  A picturi'  in  Tractatus  is  a model  of  the  world, 
qroupinq  elements  that  correspoiul  to  thinqs  (T.2.13)  into 
structures.  A picture  is  also  a fact,  T.  2.141. 

A proposition  is  made  up  of  names.  Tt  is  a fact,  its 
elements  are  related  to  each  other,  T.3.14,  and  it  is  a picture 
of  a possible  qroupinq  of  thinqs. 
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In  some  sense  the  structure  of  the  picture  should  be 
" conqr uent " to  the  real  situation  it  represents.  "Congruent" 
does  not  mean  identical,  the  correspondence  can  be  more 
compl i cated . 

This  correspondenct' , if  it  could  be  articulated  exactly, 
would  associate  meaninu  Lo  propositions.  It  is  likely  that 
Wittuenstein  did  not  have  orilinai'y  natural  language  in  mind  when  he 
discusses  propositions.  Perhajis  he  meant  "scientific  language" 
or  language  as  it  ought  to  be. 

2.2.6.  A reader  familiar  with  pattern  theory  will  recognize 
the  similarity  between  some  of  its  basic  concepts  with  the 
thinking  in  Tracteptus.  The  geneiators  correspond  to  things 

and  operators,  Tuo.  The  operators  in  O have  arities,  the 
number  of  places.  Configurations  correspond  to  facts  and  the 
connectors  allowed  in  the  configuration  space  correspond  to  the 
operators  in  U.  The  totality  F is  the  configuration  space. 

2.2.7.  In  Sections  3-7  a mathematical  formalization  of 
semantics  will  be  given  expressed  as  mappings  between  two  image 
algebras.  The  philosophical  vii'w  of  Tractatus  has  influenced 
our  way  of  formalization. 

In  his  later  years  Wittgenstein  renounced  Tractatus,  the 
work  of  his  growth.  We  shall  have  something  to  learn  also  from 
the  later  Wittgenstein,  however,  namely  about  learning  semantics. 

2.3.1.  Our  speaker/listener  will  be  immersed  in  a world  of 
sensory  impressions.  Based  on  these  sensory  data  and  with  the 
aid  of  a priori  knowledge  he,  the  observer,  makes  statements 
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or  receives  statements  about  the  state  of  the  world  expressed,  we  assume, 
in  some  formal  lanquaqe  L.  Since  our  approach  will  be  abstract, 
we  need  not  specify  whether  these  statements  are  just  declarative/ 
affirmative,  or  whether  they  can  be  questions,  expressinq  doubt, 
or  be  imperative,  and  so  on. 

The  fact  that  we  shall  use  examples  where  the  statements 
look  like  simple  Enqlish  sentences  should  not  be  taken  to  mean 
that  we  are  model  linq  the  semantics  of  F.nqlish,  not  even  a 
subset  of  it.  Our  qoal  is  to  understand  certain  mathematical 
phenomena,  not  linquistic  ones.  If  this  can  be  achieved  we 
hope  that  the  results  will  in  due  time  have  applications  to  linquistics, 
but  this  would  be  too  early’  to  claim  at  present. 

2.3.2.  The  observer's  statements  should  be  correlated  to 
his  view  of  the  world.  This  view  will  be  expressed  formally 
as  an  imaqe  alqebra  to  be  examined  in  section  3.  The  imaqe 
alqebra  should  be  mathematically  consistent,  as  will  be  proved  for  the 
one  we  propose,  but  it  need  not  be  a "true"  description  of  the  world. 

We  are  therefore  operatinq  on  three  levels,  The  "true" 
world,  the  formal  description  of  the  way  the  observer  views  the 
world,  and  the  linquistic  utterances  prompted  by  the  view.  It 
is  only  the  relation  between  the  two  latter  levels  that  we  shall 
study  here. 

2.4.1.  All  natural  languages  can  be  ambiguous,  this  has 
been  pointed  out  so  many  times  that  we  need  not  elaborate  this  trite 
fact  any  further.  In  context,  and  with  access  to  linquistic  deep 


structure,  ambiguity  may  perhaps  be  removed.  Whether  this  is  so 
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or  not,  wo  shall  simply  rovj^iiir^e  that  the  grammatical  utterances 
hav’o  a unique  semantic  cinitent. 

Most  of  our  attention  will  then  be  paid  to  the  study  of 
such  semantic  mapis,  their  mathematical  construction  and  analysis 
of  their  properties,  especially  of  their  memory  requirements  and 
limitations.  Thit  will  be  done  in  sections  6 and  7 and  in  the 
two  papers  that  are  planned  to  continue  the  present  one. 

2.4.2.  When  mathematics  is  applied  to  any  subject  matter 

one  is  forced  to  simplifications,  sometimes  drastic  ones.  This 
is  certainly  true  here,  a narrow  range  of  situations  will  be 
analyjif'd  in  some  depth  at  the  cost  of  specializing  assumptions. 

The  abstract  treatment  is  hoped  to  bring  out  the  logical  essence 

of  the  problem  as  clearly  as  possible.  This  will  avoid  vague 
generalities  and  bring  into  the  open  hidden  assumptions,  albeit 
at  the  price  of  restricting  the  scope  of  the  results. 

2.4.3.  In  order  to  pinpoint  the  concepts  needed  for  the 
mathematical  analysis  our  reasoning  will  be  dialectic,  arguing 
for  and  against  adopting  certain  notions  and  assumptions.  In 
this  way  we  have  arrived  at  a formalization  that  we  hope  will  be 
useful  for  our  later  work. 

2.5^, 1.  The  abduction  machine  analyzed  in  Grenander  (1978), 
Chapter  7,  creates  syntactic  hypotheses  sequentially,  tests 
them  and  accepits  or  rejects  them.  In  a certain  well-defined 
linguistic  situation  it  was  proved  to  yield  ultimately  a set  of 
correct  hypotheses. 
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! In  an  old  (unpublished)  theorem  the  author  once  showed 

! how  syntactic  abduction  can  be  achieved  for  languages  of  a 

' very  general  type.  This  theorem  is,  however,  only  of  theoretical 

) 

interest  since  the  algorithm  would  be  very  slow  due  to  the  fact 
that  it  is  too  general,  it  does  not  exploit  any  underlying  structure. 
Another  drawback  is  that  the  learning  would  not  be  incremental. 
Therefore  it  will  not  be  used  in  the  following. 

2.5.2.  Is  it  possible  to  build  an  abduction  machine  for 
semantic  hypotheses?  This  question  will  not  be  examined  in 
this  paper  but  its  results  prepares  the  ground  for  an  attack  on 
semantic  learning  in  a later  paper.  Mathematically  this  amounts 
to  identifying  a relation  from  a finite  set  (consisting  of 
productions  for  L)  to  the  morphisms  of  a category.  As  far  as  we 
know  this  mathematical  problem  has  never  been  studied  up  till  now. 

2.6.  The  reader  is  assumed  to  be  familiar  with  the  elements 
of  pattern  theory  as  described  in  section  1.1,  2.1,  and  3.1  of 
Grenander  (1976).  It  is  not  necessary  to  have  rend  section  2.4 
of  Grenander  (1978)  on  which  this  paper  builds,  nor  is  it  assumed 
that  the  reader  knows  the  results  on  syntactic  abduction  in 
Chapter  7 ( ibid) . 

) 
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3 . Formalization  through  regu lar  structures . 

3.1.  Any  coherent  view  of  the  world  must  be  based  on 
some  notion  of  regularity.  Otherwise  it  would  be  without  laws 
and  constancies,  with  nothing  permanent  to  learn,  no  structure 
to  discover. 

Th  regularity  need  not  be  deterministic.  On  the  contrary, 
many  of  the  phenomena  that  we  encounter  in  every  day  life  are 
ruled  by  statistical  laws  only.  Statistical  regularity  should 
therefore  be  allowed.  The  mathematical  consequence  of  this  is 
that  the  state  space  becomes  more  sophisticated. 

3.2.  To  formalize  a view  of  the  world  we  need  a precise 
notion  of  regularity.  We  shall  show  in  the  following  that 
combinatory  regularity  (pattern  theory)  is  logically  conformal 
to  the  ideas  of  section  2.2. 

3.3.  Pattern  theory  is  of  algebraic  nature  and  based  on 
the  idea  of  an  image  algebra 

(3.1)  / = ‘'G,S, 

An  image  algebra  is  made  up  of  a set  G of  generators , from  which 
configurations  are  formed  following  the  rule  of  regularity,  . 

The  group  S of  transformations  of  G onto  G,  the  similarities , 
expresses  which  generators  are  similar  to  each  other.  The  set 
of  regular  configurations  , formed  according  to  , is 

divided  into  equivalence  classes,  the  images , by  means  of  the 
equivalence  relation  R:  the  identification  rule.  The  images 
form  a partial  universal  algebra  with  respect  to  certain 
connection  operations. 

- - ^ - — - - --  ^ 
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Wo  now  discuss  the  choice  of  each  component  in  (3.1)  for 
the  purpose  of  this  study. 

3.4.1.  The  qenerators  qi  C,  shall  be  thouqht  of  as  relations 
in  a qeneral  sense  that  will  become  clearer  as  we  qo  alonq. 

In  section  (>  we  shall  relate  the  imaqe  alqebra  to  lanquage. 
Formal  linquistics  is  dominated  by  the  finitistic  attitude  so 
that  it  would  seem  natural  to  assume  that  C is  finite. 

On  the  other  hand,  we  would  like  to  let  the  qenerators 
carry  attributes  such  as  location,  orientation,  frequency, 
time,  etc.  These  are  continuous  in  nature  and  we  would  be  led 
to  allow  G to  be  infinite. 

For  the  time  beinq  we  shall  choose  the  first  alternative, 

# (G)  < ■*',  reservinq  the  possibility  of  reversinq  our  stand  if 
later  on  this  turns  out  to  be  necessary. 

3^.  4_._2 . Generators  shall  carry  two  sorts  of  boners,  in-bonds 
and  out-bonds,  loadinq  us  to  directed  regularity.  The 
out-ari^  shall  be  finite  and,  since  G is  finite,  bounded  over  G 


(3.2) 


(■'  . ( q ) < (!' 

out  - max 


+"'  . 


We  are  less  certain  about  the  in-ari ties  After 

havinq  examined  a large  number  of  cases  it  is  clear  that 
qenerators  should  be  allowed  to  accept  many  in-bonds.  Whether 
this  number  should  be  bounded  or  not  is  not  yet  clear.  We 
choose  for  the  moment  to  make  i t unbounded 


(i\ . (q)  = Vq  t G . 

in 


( I.  3) 


Note  that  all  generators  have  in-honds  but  not  necessarily 
out-bonds . 
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The  arities  as  well  as  the  values  "in",  "out",  associated 
with  every  bond  belong  to  the  bond  structure.  Sometimes  the 
different  out-bonds  have  different  functions  so  that  it  will 
be  necessary  to  indicate  this  by  other  bond  structure  parameters. 
This  will  be  done  by  markers  "1",  "2",  etc.  We  rule  out  the 
pcissibility  that  some  markers  are  equal,  at  least  for  now. 

For  the  in-bonds  no  such  markers  will  be  used  at  present; 

again  this  may  have  to  be  modified  when  we  have  learnt  more  about 

the  use  of  these  regular  structures. 

3.4.3.  To  each  bond  is  associated  a bond  value  v,  taking 
values  in  some  set  B.  We  suspect  ttiat  it  would  be  convenient 
to  make  these  values  subsets  of  G 

(3.4)  V = 2*^, 

but  in  the  present  paper  this  question  will  be  left  open. 

For  a given  generator  the  bond  values  associated  with 
out -bonds  may  differ,  expressing  their  difference  in  function. 

The  in-bond  values,  on  the  other  hand,  will  be  assumed  to  be 
the  same  The  rationale  behind  this  assumption  is  that  out- 
bonds  express  active  properties  of  a generator  (relation)  that 
may  vary  from  bond  to  bond.  The  in-bonds  express  passive 
properties  that  are  constant  for  all  in-bonds  of  the  generator. 

Wo  are  aware  of  examples  where  this  assumption  will  lead  to 


logical  inconsistencies. 


A gent'rator  may  accept  two  in-bonds 


bi'lonqinq  to  two  cjonorators,  that  , viewed  as  imary  relations, 
express  properties  that  are  not  compatible  with  each  othe^r. 

Recall  inq  the  discussion  in  section  2,  howt'Vt'r,  this  will  be 
allowed:  th<'  observt*r' s vi ew  of  ttie  world  need  not  be  consistent 

with  the  "true"  state  of  the  world. 

3.4.4.  To  be  able  to  reftM  to  tht>  i>onds  of  a qiven  qenetator 

we  need  bond  coordinates.  Thcrrfcn'  wt'  shall  enumt'ratt'  the 
out-bonds  by  1 , 2 , 3 , . . . (ij ) , with  the  conv«'ntion  that  if 

some  of  them  have  alrt'.idy  been  matked  by  the  bond  struc'ture 
parameters  l,2,...r,  then  this  numberinq  will  bt'  .ulhered  to  for 
the  bond  coordinates.  Tn  con f i qurat i on  diaqrams  bond  coonlinates 
will  be  put  inside  pa  rt'nt  heses  . 

Since  all  the  ir\-bonds  carry  the  same'  bond  value',  at  le'ast 
for  now,  we'  ne>e>d  not  distinquish  betwe'c'n  them  and  shall  not  use' 
any  bond  ('oord i nate's  for  then). 

3.4.5.  Consider  a qenerator  q with  = <»'»  so  that 

its  (out-)  bond  coordinate's  are'  l,2,...(n.  Le't 


(3.5)  7)  : ( 1 , 2 , . . . (ii ) •(  i , i i ) 

I c.  (0 

be?  a pe'rmut  at  icin  of  the'  di  first  natural  numbers.  To  e'ach  \> , 

I < V < (i),  corre'spond  bond  structui't'  pai  anie't  t'rs  B^  (q)  and  bond 
value's  (q)  . If 

J n®(q)  = R®  (q) 


(3.6) 


B^(q)  = ny  (q)  , 

‘ v 


for  all  V,  the  renumbe'r  i ncj  7i  doe's  not  affe'ct  the'  conne'ct  i vi  ty 


propt'rt  ies  of  q.  'I’lu'  se't  of  ill  such  pe'nnut  at  i ons  n forms 
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a subgroup  ^(g)  of  the  symmetric  group  over  w objects:  the 
symmetry  group  of  g . 

In  the  special  case  when  all  out-bonds  of  g carry  distinct 
markers  l,2,...u  the  symmetry  group  consists  of  the  identity 
element . 

Note  that  in  order  that  two  generators  be  considered 

identical  it  is  necessary  that  their  homologue  bonds  agree  as 

s s 

to  structure  and  value.  Bonds  for  g and  g';  B (g)  = B (g'); 
are  homologue  if  they  have  the  same  bond  coordinate. 
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r 

' 

. 

I In  Figure  3.1  the  symmetry  group  ■'^(gj^)  consists  of  the 

' identity  if  A^B,  but  is  order  2 allowing  (2)  and  (3) 

to  be  exchanged  without  changing  the  connectivity  properties 
of  ^2- 

3.4.6.  Bonds  shall  take  values  in  sets  v ^ 0.  Any 

generator  shall  have  one  and  the  same  in-bond  value  for  some 
and  then  its  out-bonds,  if  there  are  any,  shall  be  in 
The  value  of  v expresses  the  level  of  abstraction  of  the 
generator  g,  ^.(g)  = v. 

We  have  one  partition  of  G into  sets  where  k = ‘*^out^'^^  ' 

I 

I Another  partition  is  induced  by  the  level  of  abstraction  into 

1 

I sets 

(3.7)  gJ^  = (gU(g)  = v};  v=0,l,...  . 

We  shall  refer  to  generators  from  these  classes  as  follows: 


geG^ 

as 

"objects" 

t, 

g t G* 

as 

"properties" 

g^G^' 

as 

"second  level 

relations” 

geG^ 

as 

"third  level 

relations" 

To  each  g is  associated  a number,  the  level  of  abstraction, 

I = a [q)  = V denoting  the  number  of  the  set  family. to  which 


the  in-bonds  belong. 
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Conibiiiinq  all  the  elemt'iits  with  the  same  out-arity  we  get 


(J.9)  g‘‘|  = (q)  = ut 


C ) 

Lemma  3.1.  C,^  = g“;  object  s , and  only  objects , have  out-arity  0. 

Proof:  If  qi  G its  in-bond  values  are  in  . Since  has 

no  predecessor  to  which  the  out -bond  values  should  belong,  g 

can  have  no  out-bonds,  so  that  lO  , (g)  =0,  gt  G^*',  and  C7  . 

out  o o o 

On  the  other  hand,  if  gi  G*‘^,  so  that  it  has  no  out-bonds, 

then  it  cannot  hiive  in-bonds  with  values  from  any'  ^ • 

Indeed,  if  it  had  then  it  must  have  out-bonds  (with  values  from 

,)  , see  above.  Ht'nce  g^  G which  implies  g‘  c G , 

'^','-1  o ' o o 

0 . K . D . 

1.5._1_.  Th('  similarities  will  he  chosen  as  the  set  S of 
all  peimut  a t ions  s:G  ' G leaving  bcuids,  i.e.  bond  structure 
and  bond  values,  unchanged 

( 1.  10)  n(sg)  = B(g)  , Vg  t G. 

It  is  immeiHately  clear  that  t h»'  permutations  s satisfying  (3.10) 
form  a (iroup,  the  similarity'  uroup. 

q S 

since  any  s leaves  the  bond  structure  invariant,  B"(sg)=B  (q), 
it  follows  that  our  definition  of  s is  correct,  see  Grenander  (1976), 
p.  9,  except  that  (ii) (ibid)  cannot  yet  be  verified  since  the 
generator  index  has  not  bt'en  defined  so  far. 

3,5.2.  Since  the  present  S leaves  invariant,  not  only  the 


bond  structure  as  all  s i mi  1 .ir  i t i es  do,  but  also  the  bond  values, 
it  fc5l  lows  that  the  cl  .issi  f i c<it  i on  of  any  g in  terms  of  the  set 


families  is  also  S-invariant.  A consequence  is  that  the  level 
of  abstraction  is  S-invariant 

(3.11)  e (g)  = i(sg);  Vg  C G,  VsTS. 

3.5.3.  We  now  define  a generator  index  class  as  the  set 
of  all  g's  with  the  same  B(g). 

^mma_3_._2.  This  partition  is  the  finest  partition  by  any 
generator  index. 

Proof ; If  g^^  and  g2  both  belong  to  the  same  a-class  we  have 
B(gj^)  = B(g2).  Appealing  to  (3.10)  we  see  that 
B(sgj^)  = B(sg2),  VsT  S,  which  implies  that  the  u-classes  are 
invariant,  a(sgj)  = a(sq2)f  and  hence  that  a is  a legitimate 
generator  index  corresponding  to  the  similarity  group,  see 
Grenander  (1976),  Chapter  1,  Definition  1.1,  (ii). 

On  the  other  hand,  if  a'  is  some  other  generator  index  and 
a(gj^)  = n(g2^  then  by  definition  B(g^)  = B(g2).  The  permutation 
s^  of  G that  only  permutes  g^  with  g2  is  therefore  a similarity; 
see  (3.10).  But  all  generator  indices  must  be  S-invariant  so 
that  «'  (g^^)  = ot'  (s^g2)  = a'  (^2^  same 

m'-class.  This  shows  that  a classes  are  contained  in  a'-classes. 

Q.E.D. 

Note  that  generators  with  the  same  index  are  of  the  same 
level  of  abstraction,  since  if  two  generators  have  the  same 
index  a,  then  they  have  the  same  in-bond  values.  These  values 
then  belong  to  the  same  set  family  which  leads  to  the  same 

level  of  abstraction. 
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3.5.4.  Our  choice  of  generator  index  could  be  criticized 
in  that  it  is  too  narrow;  in  order  that  a(qj^)  = hold  we 

must  have  exactly  the  same  bond  structure  and  bond  values  for 
and  q2-  When  we  examplify  our  construction  by  concrete  image 
algebras  this  will  lead  to  a classification  of  generators  into 
very  small  classes,  perhaps  too  small  to  be  natural.  Some 
modification  may  be  needed  as  we  go  along. 

3^.  6 . 1 . We  now  come  to  the  rules  i|'  of  combinatory 
regularity 

(3.12)  V = <0,  '> 

with  some  bond  relation  o,  local  regularity,  and  connection 
type  )■ , global  regularity.  In  accordance  with  the  discussion 
in  section  2 we  want  our  configurations  to  consist  of  relations 
combined  together  into  a "formula'.  In  order  that  the  formula 
be  computable  we  must  choose  so  that  all  the  connections  that 
are  allowed  by  i'  make  sense. 

3.6.2.  At  first  it  seemed  reasonable  that  the  l^n^d  relation 
r ought  to  be  chosen  as  INCLUSION.  If  we  think  of  the  generators 
as  logical  operators  with  domaitis  and  ranges  we  are  led  to 
operator  conf  igurat  ions , st'e  O.renander  (1^176),  Chapter  2, 

Case  7.1,  where  INCLUSION  was  t h«'  natural  choice. 

After  examining  a number  of  special  cases  we  have  concluded, 
however,  that  the  more  restrictive  relation  p = EQUAL  suffices; 
we  choose  t’nis  definition  tempot  .ir  i ly  . 
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3.6.3.  It  is  clear  that  EQUAL  is  a legitimate  bond  relation 
for  the  similarity  group  chosen.  Indeed,  if  g^^  connects  to  g2 
via  the  bond-values  and  B2»  then  Bj^  must  equal  B2‘ 

Applying  the  same  similarity  s to  both  g^^  and  g2  will  not  change 
the  bond  values.  Hence  sg^  can  connect  to  sg2  via  the  same 
bonds,  which  shows  that  EQUAL  is  legitimate;  see  Grenander  (1976), 
Chapter  2,  p.  27. 

3.6.4.  This  choice  of  p has  implications  for  the  levels  of 
abstractions  of  connected  generators. 

Lemma  3.3.  If  a generator  g^  is  connected  by  an  out-bond  to 
an  in-bond  of  g2  then 

(3.13)  £(g^)  = !'(g2)  + 1- 

t h 

Proof ; See  Figure  3.2  where  the  (Ic)^  out-bond  of  g^^  is 
connected  to  an  in-bond  of  g2.  The  corresponding  bond-values 


Figure  3 . 2 
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are  denotea  by  6,.  and  6.  respectively.  If  g-  is  of  abstraction 
iK  in  ^ 

level  ?.  = ?.(g2)  it  follows  that  But  p requires,  in 

order  that  the  connection  be  regular,  that  B,,  = B-  so  that 

is  also  in  Then  the  in-bond  value  of  g^  must  be  in  the 

set  family  so  that  (g^^)  = ^-tl. 

Q . E . D . 

Lemma  3.4.  The  generators  in  any  regular  configuration  c have 
POSET  structure . 

Proof : Consider  a connected  component  of  c with  generators 

. . .q^.  All  connections  go  from  some  level  9.  to  some 
level  9.-1.  Defining  g^  > g^  if  there  is  a connected  chain 

(3.14)  g.  a.  g.  '•  ...  - g. 

1 il  I2  D 

it  is  clear  that 


(3.15)  Uq.)  = 9.(q  )+l  = £(q.  )+2  = ... 

1 1 I2 

SO  that  loops  cannot  occur.  It  follows  easily  that  " 
satisfies  the  postulates  of  a partial  order. 

Q . E . D . 

Generators  belonging  to  two  connected  components  that  are  not 
connected  to  each  other,  are  not  ordered  with  respect  to  each  other. 
Generators  belonging  to  a connected  component  are  not  ordered 
with  respect  to  each  other  if  they  are  of  the  same  level  of 
abstraction.  Even  if  they  are  of  different  levels  it  can 
happen  that  they  are  not  comparable  via  . 
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The  connt*ction  type  Y.  has  already  been  character i zed 
by  symmetric  reqularity:  out-bonds  can  only  connect  to  in-bonds. 
In  this  context  only  finite  configurations  will  occur.  The  main 
restriction  will  be 

(3.16)  : all  out -bonds  must  bo  connected. 

The  reason  for  adopting  (3.1&)  is  that  we  view  the  out-bonds 
as  active;  the  logical  operator  represented  by  a generator 
does  not  make  sense  unless  its  arguments  are  given. 

This  defines  the  configuration  space  in  which  we  will  be 
operating  from  now  on 

(3.17)  Plot')  = 

3.7.2.  It  may  be  remarked  that  this  connection  type  is 
not  monotonic;  if  wo  open  some  of  the  bonds  or  delete  some  of 
the  generators  (and  their  bonds)  from  a reiular  coiif  igurat  ion 
the  resulting  configuration  is  not  always  regular.  The  reason 
for  this  is  that  we  may  have  opened  up  an  out-bond  belonging  to 
the  subconfiguration,  and  this  violates  (3.16). 

N'^vertheless  we  shall  have  occasion  to  deal  with  such 
subconfigurations.  To  get  this  configuration  space  we  apply  the 
functor  ^fon  to  our  conf igurat  ion  space 


(3.18)  if')  = 4' on  ( (.  ij’) 

see  Grenander  (1977).  In  r"  ('4')  closed  bonds  satisfy  o 

but  out -bonds  may  be  left  open. 
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3.7.3.  Just  as  we  need  coordinates  for  a generator  to  be 
able  to  refer  unambiguously  to  its  bonds,  we  must  have  some  way 
of  numbering  the  generators  in  a configuration.  A configuration 
will  therefore  be  described  as  an  indexed  set  {g^;  i=l,2,...n} 
of  generators,  each  of  which  has  out-bonds  with  coordinates 
{i,l),(i,2),...(i,0^),  with  0^  = ‘out^'^i^'" 

in-bonds  of  g^  will  have  the  coordinates  ( i , 1 ) , { i , 2 ) , ( i , 3 ) , . . . . 

When  referring  to  a bond  (i,k)  we  must  also  specify  whether  it 
is  an  in-  or  out-bond. 

Such  configuration  coordinates  are  discussed,  but  in  a 
general  setting,  in  Grenander  (1977). 

Strictly  speaking  a configuration  is  not  entirely  specified 
unless  expressed  via  an  unambiguous  configuration  coordinate 
system.  Therefore  two  configurations  c,  with  generators  g^ ; 

t 

i=l,2,...,n;  and  c',  with  generators  g^;  i=l , 2 , . . . , n ' ; and 
with  bonds  denoted  as  described,  are  identical  from  the 
functional  point  of  view  if  and  only  if 


(i)  n=n' 

3.19)  (ii)  i = l,2,...n 

[^(iii)  bonds  connected  in  c should  have  their  homologues 
in  c'  connected,  and  vice  versa. 

I 

Note  that  (ii)  implies  that  n(g^)  = B(q^)  with  homologue  bonds 
given  by  the  coordinate  system. 

More  about  this  in  section  3.8  when  identification  is 


introduced  via  R. 
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3.7.4.  The  cardinality  of  can  never  be  more  than 

denumerable,  since  we  can  enumerate  by  first  a finite 

number  of  conf iqurations  in  monatomic  ones,  then  a 

finite  number  in  'f;. 2 » biatomic  ones,  and  so  on. 

I f we  exclude  the  trivial  case  when  = (j),  as  will  always 
be  done,  we  can  never  have  cardlj'C^^]  < Indeed  if  9 £ 

then 

, (3.20)  c = 4)(g,g,...g) 

; ' 

j n times 

I 

is  regular  for  any  n.  In  (3.20)  ())  denotes  the  empty  connector 
that  does  not  close  any  bonds.  That  c f V. ('^f’)  follows  from  the 
fact  that  all  out-bonds  in  c are  connected  (there  are  not  any) 
and  p holds  trivially  since  no  bonds  are  closed.  Hence 
cardlPd^)]  = denumerably  infinite. 

3.7.5.  The  generators  in  = G^,  the  objects  (see  (3.8)), 
play  a dominant  role  in  regular  configurations. 

Lemma  3.5.  All  regular  non-empty  configurations  contain  objects. 
Proof ; Consider  an  arbitrary  g(  c and  let  5 be  its  level  of 
abstraction.  If  i=Q  then  g is  an  object  and  the  assertion  holds. 

If  2,  ^ 1 then  it  has  out-bonds  in  requires  that 

they  connect  to  some  generator  g'  of  level  5,-1.  Either  5-1=0 
so  that  g'  is  an  object,  or  wo  can  repeat  the  argument;  eventually 
we  will  arrive  at  some  object  in  the  configuration. 


Q.E.D. 


.’•1 


k 1.  In  the  monot  on  i r t'xtiMision  ^ A i')  nnv'  munatomii.- 
(.■on  t 1 i|ui  .» t 1 on  is  a 1 lowed;  tin'  lovi'l  of  its  (.joni’tator'  can  t hi'n  bo 
pm'.itivt'  so  that  i.'(.m t i aviiat  i o!as  oonsist  in(.i  ('ntiioly  of 
iji'iii'f.it  ois  moil’  at'.sttaot  than  olijc'ots  o.in  oo(.’in'  in 
Rt'm.u  k 2.  A watnitni  is  motiv'at('d.  "(''bjoi’t"  lu't'd  not  lopi'osont 
an  ol>  i('(.'t  in  some  mat<'tial  W()i  Id.  As  usual,  oaut  ion  is 
foipniod  when  ma  I homa  t i i-a  I ('td  it  ii's  .uo  I'olatod  to  (.'onoi'pt  s 
vised  in  eoininon  i;<'ns('  parlaiu’e. 


A d i T( 

'Ot  ('ons('(.]U('nei' 

e>t  l.t'mm.i  l . is 

t h.it 

1 ho 

on  1 y 

iiRin.i  t om  i e 

oon  f i ([Ui  .1 1 i on.'i 

i n r ( I’l'iis  i st 

iit  .111 

oh 

it'ot  . 

1 . 7 . () . 'I’tu'  ['finu'  (•e>nl  uiuiat  ions  in  c ( i')  an'  I'asy  to 
oha  l aet  ei  i /«' . 

I.emiua  1 . ti . A (.-on  f i (.|utat  ion  ev  r (•  0 ptinu'  if  and  einly  if  it 

1 s ooniu'ct  I'd  . 

I'tiHd:  It  e is  not  I'emni'ot  I'd  it  oan  bi'  vie'wt'd  as  t lu'  -ooniu'i' t i on 

ot  two  non-i'iiipty  and  it'iuilai  eon  f i (.lui  ,i  t i ons  o'  ami  o"  v vf  f'l  . 

This  followj;  immediately  I r dm  the  t.iot  that  the  ooniu'i.' t <'ii 
eompoiu'nt  s ol  any  e an'  n'(iular:  t lu'y  s.itisty  , sine*'  all 
out-be>nds  an'  ooniK'etv'd,  .ind  ('  In'lds  trivially  in  ttu'm.  Hut 
if  o •=  (•'(e'fO"),  o'  and  o"  v ('■(?')  ni>t  t'lnpty,  then  e is  oiimpeis  i 1 1' , 
not  prime. 

On  t lu'  ot  h('r  hand  it  e is  oi'iiin'ot  v'd  it  eannc't  b»'  oxpn'ssv'il 
as  .l'(e',e"l  with  both  o'  and  e"  non-('mt'ty  and  ta'uular.  1 ndoovl , 
ni'ither  o'  nor  oan  li.ivv'  any  ('p('n  I'ut -bonds  (this  wv'vild  violatv' 
t lu'  ooiniu'otion  t yp*'  . Hut  t Ik'ii  >'  whieh  implies  that  o'  .viul 

o"  .ire  iii't  ooniit'oti'd  tv'  eaeh  ('t  tu'i  , .laainst  the  assumption. 


0 . H . n . 


r 

i 

i 


It  is  diffiTi'tit  fof  thi’  notion  roduci  blc/  i rrodnc  i bio . 

A oon  f i iiurat  i on  is  roiUiciblo  if  it  has  somo  loqular  propor 
siiboon  f iqnra  t i on  ; otiu’twist'  it  is  i rt'oduc  i bl  o . 

Iit'mma  A roqnlar  con  f i qurat  ion  c is  irrodnciblo  i f and  only 

if  it  _^s  monatoniio  and  consists  of  a sinqlo  object  . 

I'foof : The  "if"  part  is  obvious.  On  the  other  hand  if  it  is 
tiot  iust  an  isolated  ohi<'Ct  we  can  select  one  of  its  objects, 
sinc('  Lemma  1.6  assui'i's  that  it  has  at  least  tine.  Take  the 
snbconf  iqiir.jt  ion  consist  inq  of  t lii  s object  in  isolation.  It  is 
rt'qvilar,  inifilyinq  that  c is  rt'dncible. 

0 . L . n . 

3.7.7.  What  art'  the  "simplest"  reqular  con  f iqu  rat  ions? 

Kixinvi  a qi'neralor  q,  let  ns  tU'inaml  tliat  tht'  con  f i qvirat  i on  contain 
tj  but  has  no  (propi'i')  I'cqnlai  subcon  f i qnra  t i on  also  containinq 
tl . Such  a confiipirat  ion  will  In'  saitl  to  bi'  a s i mp  1 e 
q-conf  i iiurat  i on  . 

Lemma  1.8.  A conf  iqurat  ion  ct  rCti'l  is  a simpK'  q^ -^nf  iejuration 

if  and  only  if  <i)  Oj  is  tht'  uniijue  soUition  in  c ^ 

(1.21)  ((q|)=max  '!  {‘l)  = '■’(c) 

qi  c 

and,  b)  if  all  other  q.i  c satisfy  ti.  -s  q^ 

Proof:  Assume  th.at  c is  a simple'  ti  j -con  f i qurat  i on  with  C (c)  = C 

and  that  it  has  another  tp'iu'rator  q.,  with  v’(q,)  v’  . No 
descend  inq  chain  (see  1.6.2)  can  It'ad  from  q^  to  q^#  that 
wt*  can  deleft'  with  its  boiuls  from  c withtmt  It'.jvinq  any 


out-bontls  open. 


Ht'nce  a)  htibls. 


r 
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Now  assumo  that  c has  some  qoaerator  q which  is  not  suh- 
oiilinatod  to  as  in  b)  . Then  wo  can  remove  q.  with  its  l)otuis 
without  loavinq  any  out -bonds  open:  b)  holds. 

On  the  other  hand,  if  c is  a reqular  configuration  for 
which  a)  anil  b)  hold  it  cannot  be  reduced,  still  keepinq  q in  it. 
To  see  that  this  is  so,  say  that  the  reduced  configuration  leaves 
out  q.  from  c.  Since  there  is.  a tlescendinq  chain  from  q^  to  q. 
some  out-bond  will  be  left  o(>en,  when  we  delete  g^ , unless  the 
entire  chain  is  delt'ted.  But  then  q i.s  not  in  the  reduced 
con  f i cjura  t i on , so  that  the  comiition  is  both  necessary  and 
sufficient  . 

O.E.D. 

Lemma  1.8  tt'lls  us  that  t Ik'  simple  q-conf  igurat  i om  have  the 
ty’pical  appearance  i'll  Figure  1.1,  where  (!  (c)  = C(q)  = 3 and 
c cont.iins  the  two  obiects  q^^  and  q.^. 


1=0  t’  = l 1 = 2 1 = 3 


Figure  3.3 
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How  many  simple  q-conf iqurations  are  there?  With  N = #(G) 
we  qet  the'  crude  upper  bound 


d'  U)  I 

(3.22)  N X N X N X ...X  N 


max 


Tf  m x 1 this  Clives  us  the  bound 
max  ’ 


(3.23)  N 


(0  - 1 
max  _ 

(ii  - 1 

max 


The  number  is  certainly  finite,  but  it  can  be  extremely 
larqe  if  the  abstraction  level  is  biq.  This  will  have  serious 
consequences  for  the  ability  to  Ic'arti  sc'mantics  later  on. 

3.7.8.  Consider  a conf  iqurat  ion  crV>('i»')  with  a subconf  iqura- 
tion  c^(  r ('4^  • Amonej  the  c^ut-bonds  of  c^^  there  may  be  some  that 
are  open.  Close  these  bonds  by  addinej  the  appropriate’  qenerators 
of  c,  close  the  new  out-bonds  left  open,  and  continue  lilce  this. 

Since  c is  finite  the  process  will  end  with  some  reqular  sub- 

★ ★ 

conf icTuration  Cj^.  Tn  extreme  cases  c^  = c^  or  c itself.  We 

★ 

shall  call  c^  the  minimal  extension  of  c^  in  c.  The  process  can 
be  shown  to  lead  to  a unique  result. 

Lemma  3.9.  For  a regular  configuration  containing  the  generator  q 
the  minimal  extension  q*  of  th^  monatomic  subconfiguration 
V.  (‘-4’)  is  a simple  q-conf iejuration . 

Proof : The  reqular  conf iqurat ion  q*  can  have  no  (proper)  regular 

subconfiguration  containing  q since  if  c'  wore  one  all  the  out- 
bonds  of  g must  be  closed,  just  as  the  out-bond  from  generators 
connected  to  the  out-bonds  of  g,  and  so  on.  Put  then  the  above 
procedure  gives  c'  = q*,  which  proves  the  assertion. 


O.F.n. 


As  an  example,  with  c as  in  Fiqure  3.3,  we  qet  q^  as  in 


Fiqure  3.4(a)  .ind  as  in  (b)  . 


}— 0-^  { 


' ^ ' ■>  A 

Figure  <.4 

Remarl^  1.  It  is  clear  that  the  minimal  extension  is  a closure 
operation  in  the  abstract  sense  (for  a fixed  c) 


(3.24) 


c 1 ^ c ^ 


* * 

(Cj)  = C, 


where  the  inclusion  relation  denotes  the  relation  confiqurat ion- 
subconfiguration  , not  just  inclusion  of  sets  of  generators.  For 
fixed  c the  minimal  extension  maps  a subset  of  V.  (‘4f’)  into 

operation  is  also  monotonic  in  the  sense  that,  for 
fixed  Cl  y.f^'),  c^c  c2Cc  implies  Cji,  C2CC. 

^ ^ ^ • As  in  most  pattern  theory  the  homomorph i sms  between 
configuration  spaces  play  an  important  role,  see  Grenander  (1977) 
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In  the  present  case  this  is  certainly  true  for  spaces. 

For  '(.('4')  they  are  less  interesting  since  all  its  regular 
configurations  lack  open  out-bonds.  Therefore  they  can  only  be 
connected  by  the  empty  connector  o=<t> , meaning  just  disjoint  union. 
Consider  now  two  configuration  spaces  of  the  type  studied 


above  with 


(3.25) 


= <Gj^,  s^,  <y^> 


^2  = <^2'  ^2' 


and  with  a surjective  generator  map  )i:Gj  ' G2  preserving  bonds 

B(..g)  = B(g)  and  where  G^  and  G2  have  the  "same"  set  families, 

1 2 

in  the  sense  that  . 

Extend  the  definition  of  |i  to  hiV.j  '^2  putting  he, 
cf  equal  to  the  configuration  with  same  connection  but  where 

each  g^  in  c is  replaced  by  ug^.  We  then  have 

Lemma  3.10.  The  configuration  map  ^2  is  a homomorphism 

in  the  sense  of  Grenander  (1977) . 

Proof ; First  recall  how  u sets  up  a correspondence  between  the 
two  similarity  groups  and  S2.  Each  similarity  group  consists 

of  permutations  leaving  bonds  invariant.  But  u preserves  bonds, 
so  that  the  two  groups  are  isomorphic,  = S2f  although  u need 

not  be  bijective.  Actually,  both  of  them  are  the  (full) 
symmetric  group  of  the  generator  index  classes  in  G^^  and  G2 
respectively  and  these  are  bijectively  related  since  u is 
surjective . 

To  prove  Lemma  3.10  let  c G and  consider  sc,  sGS^^. 

To  calculate  h(sc)  we  first  have  to  permute  the  generators 
appearing  in  c according  to  the  similarity  c,  and  then  replace 
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Oitch  qeiiorator  q by  iiq.  But  this  leads  to  the  same  result  as  if 
we  first  replaced  each  qenerator  by  its  ii-map  value  and  then 


permuted  them  by  thi'  isomorphic  permutation  in  S^:  the  two 
operat ions  commute.  Recall  that  the  similarities  just  permute 


iiKiex  c Kisses  that  are  defined  in  terms  of  equal  bonds,  and 


that  bonds  are  preserv'ed  by  our  map. 

Finally  if  c = (’(0^,02),  with  c,c^,C2t  y,  j , calculate  hc^ 
and  hc2  and  combine  them  by  the  s_ame  connector  0 as  before. 

This  is  possible  since  bond  values  are  preserved  and  a is  IKH'Ab; 
the  connection  type  offers  no  restriction  in  the  present  case 
since  e is  not  chanqed.  But  u(hc^,hc2)  will  then  have  exactly 
the  connection  of  e (0^,02).  Its  qenerators  have  been  exchanged 
accortlinq  to  the  qenerator  map  (i  . Hence  o(hCj^,hc2)  = he  .is 
roijuired  for  h to  be  a homomorphism. 

0- E.D. 

Remark  1.  In  order  that  the  cone  1 usions of  Lemma  3.10  hold  it 
is  not  necessary  to  ri'quire  that  B(iiq)  = B(q).  It  suffices  to 
ask  that  a)  the  bond  structure  remains  the  same, 
t^^(iiq)  = B^(q),  and  b)  that  if  then 

I'i  (uq^^)  = (K  (iiq2)  . 

Rt'mark_2.  Also  the  bond  values  just  mentioncil  need  of  course  not 
be  exactly  the  same;  it  is  enough  if  there  exists  a map  iK 

between  the  two  bond  value  sets  for  aiid  G2  respectively  such 

I « 

that  the  relation  Here  and  i'2  refer  to 

I I 

Pj  and  q2,  while  and  82  ri'ftn  to  f hi'  homoloque  bonds  of  uq^^ 
and  liq2. 

This  fact  will  be  useful  later  on. 


I 
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One  particular  case  of  some  interest  later  on  is  when  in 

each  index  cl.iss  of  0,  we  sinqle  out  one  element  q , a 

1 

prototype , and  define  u as  q ► q^^  if  q belonqs  to  It  is 

easy  to  show  that  the  conditions  of  Lemma  3.10  are  satisfied 
and  hence  this  qenerator  map  leads  to  a homomorphism  between 
the  two  con f iqur a t i on  spaces. 

3.8.1.  We  art'  now  ready  to  introduce  the  imaqe  alqebra. 

The  con  f i ou  ra  t i ons  play  tht'  role  of  "formulas,"  here  satisfyinq 
the  particular  rules  If'  of  combinatory  reqularity  that  we  have 
discussed  in  st'ction  3.0.  The  imaqes,  on  the  other  harul, 
express  tht'  "function"  id  these  formulas. 


In  t Ll'  present  cast'  the  i di'nt  i f i Ciit  ion  rult'  R (see 
Gicn. Hitler  (1970),  st'cfion  3.1)  will  be  chosi'ii  to  make  the 
functions  coorcUnate  f re_e  - the  choice  of  coordinate  system  for 
dt'serihinq  con  f i t^u  rat  ions  should  be  irrelevant. 

To  formalize  this,  consider  two  reqular  conf iqurations  c 


aiul  c'  with  n qenerators  q^,q2,...qj^  in  c and  n'  qenerators 

t I I 

u j , q2  , . . . q^^,  in  c'  respectively.  The  bond  coordinates  will  be 


di'noted  bv 


(3.20) 


(k,  1 ) , 1 = 1 , 2,  . . .rij^ 

J 

I 


for  qj^  ; k = l , 2 , . . . n 


|^(k',i),  1 = 1,2,  ...nj^  for  q^^;  k = l,2,...n' 


We  shall  let  R identify  c and  c'  if  and  only  if  (a)  n=n ' , 


(b)  there  exists  a permutation  (1,2, ...n)  ' ( i ^ , i 2 » • • • i ) such 

I I 

that  q,  = q , k=l,2,...n,  (c)  for  each  k we  have  n,  = n . , 

k ^ k 

(d)  for  each  k there  exists  a fiermutation  (l,2,...nj^)  ‘ 

such  that  the  bond  of  q^^  equals  in  structure  and  value  the 
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bond  of  g.  , and  (e)  bonds  corresponding  to  each  other  are 
connected/not  connected  in  the  same  way. 

Lemma  3.11.  This  R is  an  identification  rule  for  and  for 

t ( • 

Proof ; That  R is  an  equivalence  is  obvious.  Also,  if  c and  c' 
are  regular,  and  if  they  are  R-equivalent , cRc',  then  c and  c' 
have  the  same  unconnected  bonds,  related  by  a permutation.  These 
are  the  external  bonds,  same  for  c and  c'.  We  shall  then  in 
the  following  assume  that  the  coordinates  have  been  permuted, 
if  necessary,  so  that  the  external  bonds  are  the  same  for  each 
coordinate.  Further,  if  again  cRc',  then  if  we  apply  the  same 
similarity  s to  c and  to  c ' we  can  relate  sc  and  its  bonds  to 
sc’  and  its  bonds  by  the  same  permutation  as  for  c and  c'. 

I f 

Hence  (sc)R{sc').  Finally,  if  c^Rc^  and  C2RC2,  where  all  four 

f 

configurations  are  regular,  then  c^  and  c^^  have  the  same 
external  bonds,  related  by  some  permutation,  and  similarly  for 

I 

Cj^  and  C2*  Connect  c^  and  C2  into  some  regular  configuration 

I I 

c = a(Cj^,C2).  We  now  connect  c^  and  C2  by  the  same  a expressed 
in  the  coordinate  system  mentioned  above.  It  follows  that 

I I 

c’  = a(Cj^,C2)  is  also  regular,  since  bonds  connected  in  c 
correspond  to  bonds  connected  in  c',  and  vice  versa.  The  bond 
relation  is  therefore  satisfied  for  all  closed  bonds  in  c'.  The 
connection  of  c'  is  also  in  5'.  But  the  new  c'  , now  known  to  be 
regular,  consists  of  the  same  generators  as  c,  and  with  the  same 
connections,  related  by  permutations  as  described.  Hence  cRc' 
which  shows  that  R has  all  the  properties  of  an  identification 


rule . 


Q.E.D 
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1 


Combininq  Lemma  3.11  with  the  properties  shown  for  p and 
we  have  proved 

Theorem  3.1.  With  c and  R as  given  above  /=  <r'(i|'),R> 
i_s  an  image  algebra  and  so  is  y = <r  ( <')  » R • 

In  the  following  all  perceptions  of  the  world  will  be  expressed 
in  image  algebras  of  this  form. 

3.8.2.  Any  S-invariant  class  of  images  forms  a pattern. 

Among  these  are  those  generated  by  a template  1^^ 

(1.27)  I>  ( 1 ) = • s T I V s • S ■ 
o o ' 

Two  patterns  P(lj)  and  P(l2)  torm  in  (3.27)  are  either 

identical  or  disjoint. 

Two  distinct  image's  in  a }>atti'rn  describe'  differe'nt 
pere'eptions  of  t lu'  world,  since  otherwise  tht'y  would  be 
lele'nt  i f ie'd  by  R,  but  they  have  the  same'  logical  structure.  That 
this  is  so  folie^w.s  from  tl  tact  that  they  are  made  up  of 
ge'iie'rators , say  g for  1^,  and  t hi'n  sg  for  that  have  the 

same'  ge'nerator  index  and  play  t hi'  same  logical,  but  not 
substantial,  role. 
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4.  Two  special  imago  algebras 

4.1.  The  construction  of  the  imaqe  algebra  in  the  last  section 
is  based  on  simple  pat  tom theoret ic  ideas.  Nevertheless,  it  takes 
some  expeiienci'  of  manipulating  configuration  spaces  and  their 
images  before  one  In'comes  familiar  with  sucli  structures.  To 
fac'ilitate  this  for  t tie  reader  wi'  luiw  presmit  two  fairly  simple 
t'xamples,  t lie  first  completely  abstract,  the  second  with  an 

intuit  ive  i nterfiretat  ion  . 

They  will  appear  quite  tliffi'rent  from  each  other  but,  as  we 
shall  show  in  section  4.4,  they  are  closely  ri'lated  to  eacli  other. 

4.2.1.  Let  c'onsist  of  the  12  abstract  geiu'rators  in 
Table  4.1.  As  identifiers  we  have  chosen  simply  the  letters  of 
the  alphabet  and  as  bond  values  Roman  numerals. 

The  out-arities  of  these  generators  vary  between  0 and  5, 

the  obiects  wi  th  . = ? = 0 consisting  of  the  two  generators 

out 

k and  > . 

The  Ic'vels  of  abstraction  vary  between  ?=0,  for  the  two 
objects,  to  i’  = 3 for  a and  b.  The  two  partitions  1 tVM  and  i tl  V 
are  given  in  Tables  4.  1 and  4.4. 

Tht'  bond  valiu's  art'  from  t ht'  st't  s as  tlescribt'd  in 

V 

st'ct  ion  1 . 4 . ()  and  tabulatt'd  in  Talilt'  4.2.  Ont'  tu'od  not  spt'cify 
the  in-bond  values  of  the  in'iu'i  a t ors  of  maximum  It'Vt'l  iif 
abstraction  since  no  out-bond  can  connect  to  thi'm.  This  is  why 
the  cells  for  are  empty  for  the  two  first  rows  of  Table  4.1. 
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1 

TABLE  4.1  I 


GENERATORS  EOR 


number 

idonti f ior 

1 eve  1 

i n 

' out 

“^outl 

^'out  2 

H 

out  3 

^\')Ut  4 

^^ou  t 5 

1 

3 

- 

2 

I 

I 

- 

- 

- 

2 

b 

3 

- 

1 

I 

- 

- 

- 

- 

3 

c 

2 

I 

1 

II 

- 

- 

- 

1 

1 -1 

d 

2 

I I I 

1 

I I 

- 

- 

- 

i 5 

o 

•> 

I 1 1 

1 

1 1 

- 

- 

- 

6 

f 

1 

1 I 

5 

V 

V 

V 

V 

1 

! 

1 -) 

1 

q 

1 

I I 

I 

V 

V 

VI 

- 

i ^ 

h 

1 

I 1 

1 

VI 

- 

- 

- 

1 

1 

1 9 

i 

1 

I I 

4 

VI 

VI 

V 

V 

- 

10 

i 

1 

VI  I 

1 

VI 

- 

- 

- 

- 

1 1 

k 

0 

V 

0 

- 

- 

- 

- 

- 

12 

1 

0 

VI 

0 

- 

- 

- 

- 

- 

TABLE  4 . 2 


LJ 

SET  eAMI'LY  / FOR  V,  

V’  1 

1 / 1 

• V , V I ■ ' 

1 

O 

[ , 

^‘i 

t 

' I I , I V , V I I!  1 

1 

; "2 

{I,  im 

TABLE  4 . 3 


3b 


i*. 

V 

G 

V 

0 

{ k , i t 

1 

; f , q , h , i , i ' 

*) 

*• 

' c , d , o ■ 

’1 

■'  a , b ■' 

TABLE  4 . 4 


1 ^ ' 

0 1 

■,  k , { } 

1 

' ■ 

b,c,d,e,h,il 

' 

{a} 

^ L 

(q) 

37 


V’u’ii  t hi'  c'lut-arity  I'xcc'fds  oiu'  wt'  tu't'd  qi'iu' ra  t (ir  cocirditi.iti's 
to  koop  hotuis  apart  , .iiul  this  )ias  lioi'ii  dotio  by  numbors  1,2,... 
maikinq  t ho  out-boiuls.  I ti-botxl.s  aro  troati'd  ii.s  i dt'n  t i ca  1 , for 
any  qiv't'n  qonorator,  .itul  thoroft  to  riood  no  coord  i na  t I's . 

'I’h  i s is  of  course  a quite  sm.)  1 I qenerator  space.  Actu.illv', 

It  we  caU'ulate  the  qeneiatiq  clar.se;;,  puttinq  the  qi'uerator 
i lulex  equal  to  a constant,  we  si'i'  that  each  qenerator  const  ituti's 
its  own  qenerator  cl.iss,  with  t hi'  exception  that  d and  e bt'lonq 
to  the  s.niie  c 1 .iss  , a (d  ) u (e)  . 

I'lq  this  rea.'nni  we  h.ive  a pool  qroup  ol  siniil.irit  ies,  only 
a 1 I ow  i lu:  a permutation  at  d .ind  i'.  'I’h  i s.  is  not  a typical 
situat  ion,  but  occiii  led  since  we  chos.e  very  simple  I'xample. 

‘1 . .1 . 2 . We  c'an  now  combiiu'  the  qc'iierators  .i,b,i',... 

f(  1 1 ow  i nq  t lu'  rules  i'  of  combinatory  lequ  1 a i' i t y . We  qet  , fc'ir 

example  the  ri'qular  confiiiural  ion  (a)  I'onsist  i nq  of  the  iii'iu'rat  ors 

k,  occurrimi  twice,  q , t’ , and  j.  It  cinilains  t lie  obiects,  of 

type  k and  t’ , and  is  of  abstract  ion  1 <.'ve  1 line  due  t d t tu' 

occur!  eiu'i'  of  t hi'  qenerators  q and  j.  'I’o  prove  that  (a)  s.it  isfii'.s 

t'  e,  ■ we  first  note  from  'I’.ible  4.1  that  m . (k)  = i.'  , ( i 

out  out 

so  that  k .ind  f havi'  no  out-bonds.  Also  that  q has  three  out-boiuls, 
all  indicated  in  the  di.iqram,  and  ] has  one  out-bond,  also  shown. 

.‘-'i  i nee  all  t hi'se  linir  out -bonds  .iie  c I osi'd  in  the  diaqiam  t hi' 

connect  ion  type'  )!  is  s.it  i s f i ed . Now  took  at  the  toui'  closed  bonds 

in  the  di.iqram,  lor  ex.imple  the  one  I rom  <|  to  the  upper  k.  I’rom 


•I  . 1 we  t i nd  th.it  t hi'  tirsi  out -bond  of  q h.is  bond  v.i  1 ue  V,  .ind 
that  the  in-bond  v.i  1 ue  ot  k is  V,  eipKility  holds  .ind  p is 


sat  istii'i.1  tm  this  IhmuI  . 


li>  t tu'  saini'  way  wr  clu't'k  t hr  i)t  tu'i 


t't 


t'cimis  aiiii  I'onr  1 udi'  tti.it  i'  tiolds:  (.1)  is  .1  tt'qul.u'  con  1 i qur.it  i on  . 

It  is  not  .1  sinipli'  q-ciMi  t' i qn  i .1 1 ion  s i nci'  i c.an  bt'  itroppoit 

witliout  dostroyinq  t lu'  roqularity.  llowi'voi',  w i t ti  i di'U'ti'd, 
t tie  ri'sultinq  lUibcon  t i ipit  ><  t i on  is  q-simplo. 

Anotlii'i  ox.inipli'  is  qivi'n  in  (li)  w i t ti  n(c)  = 7.  It  consists 

ot  t tie  qi'iu't  .itors  k,  oci’urrinq  twice,  o,  twice,  .nut  q,  h,  .ind 

It  is  ot  .ilistr.u’t  ion  1 1'Vi' I two,  itue  1 1'  t lu'  ('i-eui  ri'iici'S  ot 

e.  It  we  d.i'lete  t tie  bottom  i'  .ind  ti  we  qi't  an 

e-sinipte  snl'con  t' i qu  r.i  t ion. 

•1.  1.1.  I.et  ns  lU'w  look  .it  .1  iiieqi'  interest  inq  ex.imple  w i t ti 

t lu'  PI  qi'iiei  .1 1 or  s 1 i r.  I ed  in  T.it'  1 e t oiu' t tier  w 1 t ti  t lu'  i 1 1 eve  1 1'. , 

on  t -.1 1 I t i es  , .iiui  tumd  v.iliu's. 

In  .idd  i t i on  t tu'  t .it'  1 e I'l'ii  t .1  i ns  i den  t i t i or  s , tnit  now  in 

t tie  term  cit  Mnqlisti  word(s),  intended  to  qi\’e  t tie  rc'.ider  .1 

concrete  ide.i  ot  t tie  purpose  ol  t ti  i r.  ri'qul.ir  structure  Ttie 
ide.i  is  to  t orm.i  1 i re  ti.ind  motions  ot  two  i nd  i v i du.i  1 s work  inq 

witti  .1  lew  ttiinqs  ni.ule  of  met.il.  Tti  i s stitnild  be  comp.ired  to 

t tu'  discussion  in  sciMion  1.7  ot  tit  en.iiiiti'i  (l‘l7ti)  on  motion 

f. tiulii's,  .ind  to  (.'.ISO  1 . (1 . 4 (.in.i  t 0111  i im  1 (MttiMiis),  it'id. 

A lew  it'iii.iiks  will  tie  in  ordet  . Ttie  i n-t'ond  v. lines  !•'  .ind  F ' 

'never  oceui  .imotui  out -tiond  v.i  I nes . 'I’ti  1 s imi'lies  Iti.il  ttie 

qeiK't  .1 1 iirs  tl-ltl  .ind  .M-2ti  tu'vei  .icci'pt  out -tiond:'.  I rom  ot  tier 
ijener.i  t or:i . 

We  ti.iv'e  tw(i  qeiii'i  .1 1 01  riqtil  .ind  liqtit'  tti.it  seem  to  pl.iy 
I tie  s.ime  1 1 ' 1 (>  .nut  .1  n.  1 1 oqi  mi;;  1 y t o 1 1 e I t .ind  1 1'  I I ' . 'I’ti  i s is  not  ;io  , 


40 


howovor.  The  qenerator  q = right  connects  to  g = arm,  but  not 
to  hand.  The  generator  rigtU  ’ , on  the  ot  ht'r  hand,  connects  to 
hand,  but  not  to  arm.  We  have  thought  of  an  arm  as  being  made 
up  of  variou.s  parts,  oi’u.'  of  thi'iii  In'inij  a hand.  It  is  then  not 
appt'alim]  to  allow  the  s.rmt'  uniiry  relation  (property)  to  be 
applicablt'  to  both,  on  various  K'vels  of  abstraction. 

The  vagut'ness  of  every  d,iy  language  timds  to  conceal  such 
subtle  semantic  distinctions,  but  one  of  the  advantatjes  of  t hi' 
afistract  approach  is  that  it  foici'S  firecision  upon  us. 

This  is  of  more  ireueral  s i gn  i f i canci'  than  may’  be  immediati'ly 
obvious.  If  we  di'cided,  against  the  reasonirnj  just  given,  that 
a oenerator,  for  example  ri^ht,  should  be  allowed  to  connect  to 
generators  of  differerit  levels  of  abstraction  we  would  have  to 
modify  the  assunifitions  in  3 . 4 . h . This  can  certainly  be  dotu' , 
and  with  little  effort,  but  for  the  time  being  this  does  not 
si'em  to  be  motivated. 

The  generator  grasp,  of  oirt-arity  three,  should  be  read  as 
"grasp  something^  between  finger j anil  fingi'r.,".  The  markers 
are  t hi'  boml  coordinates.  The  generator  ppo  ss , of  out-arity  foirr , 
should  be  read  "press  something^  against  something^  using  finger^ 
and  fintjer^.  The  remaining  generators  need  no  explanation. 

4.3.2.  The  set  families  jA  are  given  in  Table  4.b,  and  the 

- - 

partitions  according  to  It'vel  and  out-arity  in  Tables  4.7-8 
r <'S[)ect  i ve  1 Y . 

The  indt'X  classef;  are  i'a>:i  ly  c.ilculated;  see  the  diseieunen 


i n sect  i on  3 . . 


There  ate  1 1 of  t hi'm  givi'tr  i it  Tal'ile  4 . . 
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TARLK  4_^ 
GFNF.IWrORS  FOR 


luimbor 

idont  i f i I'r 

leve  1 

11 

(0 

out 

*'out  1 

^’out  2 

^out  3 

^^out4 

*'out  5 

1 

individual  1 

3 

2 

11 

H 

- 

- 

- 

> 

iiulividual  2 

3 

- 

2 

II 

II 

- 

- 

- 

3 

left 

3 

- 

1 

II 

- 

- 

- 

- 

4 

r i 11  h t 

3 

- 

1 

H 

- 

- 

- 

- 

5 

hor i zona  1 

3 

- 

1 

II 

- 

- 

- 

- 

(i 

vert ica 1 

3 

- 

1 

H 

- 

- 

- 

- 

7 

arm 

2 

II 

1 

G 

- 

- 

- 

- 

9 

idle 

3 

F’ 

1 

G 

- 

- 

- 

- 

9 

St  ronqly 

2 

F' 

1 

C 

- 

- 

- 

- 

10 

weak ly 

O 

p> 

1 

C 

- 

- 

- 

- 

1 1 

clockwise 

2 

F ’ 

1 

D 

- 

- 

- 

- 

1 •: 

cininterclockwi 

sr*  2 

F’ 

1 

D 

- 

- 

- 

- 

1 < 

left' 

2 

F ' 

1 

G 

- 

- 

- 

- 

1 4 

I i qht ' 

> 

F' 

1 

G 

- 

- 

- 

- 

1 S 

hor i zon  t a 1 ' 

2 

I” 

1 

G 

- 

- 

- 

- 

1 f. 

vert ical ' 

F’ 

1 

G 

- 

- 

- 

- 

1 7 

down 

') 

F' 

1 

F 

- 

- 

- 

- 

1 8 

up 

2 

F' 

1 

F 

- 

- 

- 

- 

1 9 

hatui 

1 

I'l 

5 

B 

B 

B 

B 

B 

2 0 

(irasp 

1 

(' 

3 

n 

B 

A 

- 

- 

21 

rotate 

1 

!•) 

1 

A 

- 

- 

- 

- 

2 2 

prt'ss 

1 

F 

4 

A 

A 

B 

B 

- 

2 3 

brass 

1 

I' 

1 

A 

- 

- 

- 

- 

2 4 

steel 

1 

F 

1 

A 

- 

- 

- 

- 

2 5 

1 i 1 1 1 e 

1 

F 

1 

A 

- 

- 

- 

- 

2(> 

biq 

1 

F 

1 

A 

- 

- 

- 

- 

27 

thumb 

0 

B 

0 

- 

2 8 

index  finqer 

0 

B 

0 

- 

- 

- 

- 

- 

2 9 

middle  finqer 

0 

B 

0 

- 

- 

- 

- 

- 

30 

rinq  finqer 

0 

B 

0 

- 

- 

- 

- 

- 

n 

little  f i ncp'r 

0 

B 

0 

- 

- 

- 

- 

- 

12 

bol  t 

0 

A 

0 

- 

- 

- 

- 

- 

1 3 

nut 

0 

A 

0 

- 

- 

- 

- 

3 4 

cy  1 i luh'r 

0 

A 

0 

- 

- 

- 

- 

- 
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TABLE  4 . 9 


X 

# 

1 

'1,21 

2 

2 

1 3 , 4 , 5 , 6 f 

4 

3 

(7 '• 

1 

4 

{ 8 1 

1 

5 

113,14,15,161 

4 

6 

19,101 

2 

7 

{ 11 , 12} 

2 

8 

117,181 

2 

9 

119  1 

1 

10 

1 20  1 

1 

11 

1 21  1 

1 

12 

1 22  ' 

1 

1 3 

123,24,25,26] 

4 

14 

1 27,28,29,30,31  ) 

5 

15 

1 32,33  , 34  1 

3 

34 

Thf  reader  may  be  interested  in  recoqnizing  the  common  character- 
istics, in  every-day  language,  of  generators  with  the  same 
inilex  (.  Tt  is  also  of  interest  to  compare  tlie  index  classes  with 
till'  map  II  i ti  Table'  4.9  and  the  relation  H ‘ t' ' in  Table  4.11. 

The  similarities  are  now  many  more  than  in  the  first  example. 
The  group  S of  similarities  is  the  direct  product  of  full  symmetric 
groups  of  order  ? . 4 , 1 , 1 , 4 , . . . ; see  the  last  table.  Hence 


= 2!4! • • • S 1 .6-10^ 


(4.1) 


# (S) 
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4.  Combininq  tho  qonerators  thumb , index  ^ijigcjr , grasp , 

bolt,  brass  wo  qot  tin'  roqular  configuration  in  Figure  4.2(a). 

Anothoi  oni'  is  shown  in  (b) . A more  complicated  case  is  given 
in  (i.')  with  n(c)  = IJ.  The  sub-configuration  c'  inside  the 
dottt'd  contour  is  rt'qular,  and  can  bo  thought  of  as  a macro- 
uonorator,  see  Crenandor  (I'??!)),  p.  32.  The  whole  configuration 
is  of  abstraction  level  three. 

'I'wo  macro-generators  c"  and  c"'  appear  in  (d)  , whore  two 
individu.ils  are  at  work  together.  This  configuration  is  also 
of  abstraction  level  3. 

The  configuration  c^  in  the  figure,  in  (e) , is  simply  - 

related  to  thi'  otu'  c^  in  (a):  they  are  similar,  c^  = sc2,'t  S. 

F3t'gular  configurations  as  above,  and  the  resulting  images 
in  ,,  describe  hand  motions  of  one  or  two  individuals.  It 
would  be  misleadinc^,  however,  to  say  that  such  images 
certain  motions  in  the  physical  world.  To  do  this  we  would  need 
another  formalization  of  the  physical  worlds  since  in  our  way  of 
thinking  semantics  means  a correspondence  between  two  regular 
structures:  it  is  hierarchically  organized. 

As  pointed  out  in  section  2 we  do  not  necessarily  assume  that 
the  fierception  of  the  world  of  our  observer  is  logically  consistent. 

As  a matter  of  fact  the  term  "logically  consistent"  requires  that 
second  regular  structure  just  mentioned,  which  may  be  absent. 

Without  introducing  it  we  should  not  worry  too  much  it  we 

encountt'r  images  in  with  individuals  with  five  thumbs,  or  two 
individuals  sh.irimj  an  arm. 

J 


individual  1 


) 
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I f we  want  to  remove  such  images  from  the  algebra  it  can 
bo  done  by  labelling  in-bonds  by  markers;  at  the  present  stage 
this  does  not  seem  necessary. 

The  last  configurations  (f),  (g) , (h)  are  similar  and 

belong  to  the  same  pattern  as  the  one  in  (a) . This  can  be 
checked  using  Table  4 .10  specifying  the  similarity  group  S. 

4.4.  To  establish  a correspondence  between  our  two  con- 
fiquration  spaces  (as  well  as  the  related  image  algebras)  we 
! consider  the  following  generator  map  ii:G~  <■  G,  together  with 

i 


i 

i 


the  table  of  the  associated  bond  value  map  p '■  B ' ; see  Tables 


4.10-11. 


Table  4.10 


r 

a 

ug 

g hg 

ug 

1 

13  O' 

i 25 

j 

2 

a 

14  e 

26 

j 

3 

b ' 

15  e 

27 

k 

4 

b 

16  e 

28 

k 

5 

b 

17  e 

29 

k 

6 

b 1 

18  e 

30 

k 

7 

c 1 

1 19  f 

31 

k 

8 

d 1 

I 

20  g 

32 

1 

9 

e 

21  , h 

33 

i 

10 

e 

22  i i 

34 

e 

11 

e 

23  i j 

12 

e 

24  j 

Table  ■} . 1 1 


R’ 

h' 

A 

VI 

F 

1 1 

B 

F 

IV 

C 

T I 

F' 

1 1 1 

n 

T I 

(', 

1 1 

H 

I 

Rt.'r\'rrino  to  Remark  2 in  .1.7.9  we  can  verify  that  u qenerates 

a homtmiornh  i sm  h:(-  ^ ‘ have  to  check  that,  (a)  , u 

s s 

preserves  bond-structure,  B" (Hq)  = (q) , usinq  Table  4.9 

toqether  with  Tables  4.5  and  4.1,  and  that,  (b) , the  bond 
values  behave  as  required  in  tln'  quoted  Remark  2. 

Applyinq  this  homomorf.'tii  sm  for  example  to  (a)  in  Fiqure  4.2, 
wt'  qet  the  t ^ -con f i qurat  ion  (a>  in  Fiqure  4.1.  In  the  same  way 
the  ,-con  f i qurat  i on  (b)  in  Fiqure  4.2  is  carried  over  into  (b) 
in  F i qure  4.1. 

•As  all  homomorph  i sms  , h loses  information;  a c.  ^ -conf  iqura- 
tion  (or  in  fj)  is  less  informative,  althouqh  topoloq i ca 1 ly  the 
samt',  compared  to  a .,-conf  iqurat  i on  (or  one  in 
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5.  Tho  choice  of  language  typo  for  the  study. 

5.1.1.  In  accordance  with  tho  discussion  in  section  2, 
and  with  the  stated  reservations,  we  shall  choose  the  type  of 
lanquaqe  to  be  used  by  the  speaker,'!  istener  as  finite  state . 

We  can  be  quite  brief  when  discussinq  these  lanquaqes,  they 
are  so  well  known. 

5.1.2.  The  qrammar  will  be  based  on  a vocabulary 

V = V,^  U . Here  V,j,  is  the  terminal  vocabulary  consistinq 
of  the  words  to  be  used.  We  shall  sometimes  use  Greek  or 
Roman  letters  to  denote  the  elements  of  V,^,  and  occasionally 
common  words  in  English.  In  the  lattt'r  case  we  have  to  watch  out 
so  that  we  do  not  forget  that  they  should  be  treated  abstractly, 
not  representing  a sub.set  of  real  English. 

The  non-terminal  vocabulary  consist  of  syntactic 
variables^  or  j^tates.  They  will  be  denoted  by  numbers  1 , 2 , ,I , . . . F , 
where  F indicates  the  final  state.  We  shall  use  the  convention 
that  1 is  the  start  state. 

5.1.3.  The  p^rqductions  in  can  always  be  qiven  in 
canonical  form  as 

(5.11  i ' j , X . V,^,  i , j t . 

X 

We  can  read  (5.1)  as  "the  state  i goes  into  i while  writing  the 

terminal  symbol  x".  .Romet  imi's  it  will  be  conv'enii'nt  to  let  x 

* 

in  (5.1)  indic.itt'  a finitt>  string  instead,  x<  V^,  but  this  will 
not  affect  the  generiitiv’e  power  of  the  gi'ammar. 


k 


M 


,1  :'.sum<' 
so  t h,i 

nni;-.  t o 

so  I ll.l 
into 

In  (■>. 


oi  >nst  1 t 
Vv'  1 

I oqu  i I 

(■-.  n 

’ITu'y  n< 
n.  i iin  i I 

t 1 n 1 t o 
t o I III  . 

ii  1 von 


1 . •!  . .lust  ns  in  ttronniuloi  (1*178),  I’hnptoi  8,  wi'  sh.i  1 I 


t hn  t t !io  iiinmiiMi  has  hoon  i isluoi'ii  to  di' I onii  i n i st  i o loni'. 


any  pfoilnot  ions,  in  ol  I ho  lonii 


/ 

I ‘ 1 

X 

i ‘ k 


oitu'iilt*,  i k.  This  IH.lkl'^:  ol  son  t (MU'iv;  unanib  i *.]  nous  , 


I it  X , X . X ....  X i r.  <M  .iinin.i  t i o.  i 1 it  hio;  .i  un  i qiu'  pn  t s i iu| 
I ^ n 


X 


X 


X 

w 


^ ) wi'  h.iv'i'  p.i  I si'vl  t ho 


n-  1 

X 

n 


* 


'I’ho  sot  I,.  V,|,  ol 
n t os.  t lio  1 a mni.uio  qt'iit' 
t h I ho  s.iiMO  prooodu  i o 
I till  t lia  t t ho  St  a t o i 

o 


s.iMilonoo  into  suoooss.ivo  pioiiuol  i ons 

r. 

I i n i I o si  I i luis.  pi  oiiiun'd  1 i ko  this 
r, it  Oil  by  t hi'  I .iiupi.uio  , 1.  ). 

loi  proiiuoiiui  stiiiuis,  but  not 

I Ol  i K,  v\to  pot  qi. iiiim.il  i oa  I phi.i.so.s 

II 


'Oil  II 't  bo  I onq  to  I ho  I .inquaqo  , but  will  bo  o t I i iiqu  i s I i i 

i 0.11100  .iiiyw.iy  . 

. I'.qu  i v.i  I out  ly  I ho  laiiiiuaqo  o.iii  bo  i opros.oii  t ml  by  .i 
auloiiiatoii  th.il  wo  sh.i  I 1 olloii  pit'i'.onl  in  il  i .ui  r.imiii.i  t i o 

To  o 1 a I 1 I y Mio  not  .i  I ion  oons.  i tio  i t ho  I i n i t o .in  t oiii.i  ton 

by  t ho  s I iiip  I o w i 1 i ini  il  i an  i .im  in  I-'  i n n i o . 1 . 


Fiuiitt'  '.1 


Tht'  cof  rt'SiHMiii  i tui  qramm.u'  has 


a , b , c 

n , 2 , ^ , I ’ ! 


aiui  thr  proihict  i ons  i ii  t hi'  tabli' 


Table  '1.1 

1 ' 2 ^ 
a 

1 ' 4 

e 

' F 1 

4 .*  1 

b 

b 

2 > 2 

4 • F 

e 

a 

> . i.' 

b ' 

It  is  obviously  li.' t I'tmi  ti  i s ' i o . 
par sod  as 


J 


1 2 2 2,  F 

a c c b 

1,1  4,  1 4 F 
b c b c <» 


It  uonorati's  for  example  sentences 


K 1 4 F 
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and  f>htasi''s  liko 


(5.7) 


2 2 2 
c c 


3 4.  3 4 
c b c 


5.3.  Another  equivalent  way  of  representinq  finite  state 
languaqes  is  via  regular  expressions  from  formal  logic.  Such 
expressions  are  built  from  concatenation,  finite  repetition 
(indicated  by  a star),  union,  and  parentheses  to  indicate  order 
of  execut ion . 

The  lanquaqe  generated  by  the  wiring  diagram  in  Figure  5.1, 
for  example,  '^an  then  be  written  as 

(5.8)  I,  = (ac*liU(bc(bc)  *a) 


It  is  clear  #(!,)  = f >■  if  and  only  if  the  regular  expression 
contains  .it  lodst  om'  star.  This  is  the  only  case  of  interest 
for  us  and  will  be  assumed  throuqhout  this  paper, 
k 5.4.1.  V^r  t ho  followincj  it  is  of  paramount  importance  that 


finite  state  lancjuages,  as  well  as  many  ottier  formal  languages, 
c^n  be  vi t'wed  as  combi  natorv  regular  structures;  see  Grenander 


(1976)  , 

Sect i ons  2 . 4 and 

3.2. 

The 

generators  will 

then 

ho 

ri'present  ed 

by  t he 

product  ions 

(not 

by  words!)  Ttu'y 

hiive 

. = 

in  out 

1 , with 

the  in-bond 

value  given  by  the  st.itf' 

i t o 

ht 

' rewr i t f en 

in  (5.1) 

<ind  the 

out -bond 

va  1 lie  as  j , t Ih’ 

rosn 

1 t i 

nq  state. 

Fur  t ht'r 

e = 'FOFAI,' 

and 


LINFAR. 
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The  identification  rule  R to  be  used  then  identifies  two 

regular  configurations  (grammatical  phrases)  if  they  consist 

of  the  same  string  of  terminal  symbols  and  have  the  same  external 

in-bond  value  and  the  same  external  out-bond  value.  Remember  that 

the  finite  automaton  was  assumed  to  bo  deterministic;  then  each 

image  consists  of  a single  configuration. 

■).4._2.  Strictly  speaking,  this  image  algebra  represents 

not  just  L,  but  all  grammatical  phrases  in  L.  When  we  want 

to  limit  ourselves  to  just  L,  we  need  two  more  generators,  one 

a'  with  '^'out^'^^'^  ~ ^ with  out-bond  value  1,  and 

F . p F 

another  one,  g , with  ) = 1,  ~ 0 with  the  in-bond 

\’aluf  F.  We  shall  then  let  be  the  image  algebra  consisting 

all  images  in  With  out-arity  xero.  ^ will  reap{n'ar  in  the 

next  section  as  the  secondary  image  algebra  in  semantic  relations. 

It  we  apply  the  function  ^on , the  monotonic  extension 
functor,  to  the  above  x and  we  get  new  images  consisting  of 

grammatical  phrases  and  unions  of  unconnected  grammatical  phrases. 


6.  Semantic  maps 

6.1.1.  We  shall  now  try  to  formalize  in  algebraic  form  the 
ideas  ori  semantics  from  section  2.  To  begin  with  we  shall  do 
this  in  a fairly  general  setting,  attempting  to  bring  out  clearly 
the  major  problems  that  confront  us  in  our  task.  Gradually  we 
shall  specialize  by  bringing  in  restrictions  on  the  semantic 
maps,  and  in  section  7 we  can  examine  the  detailed  structure 

of  some  semantic  schemes. 

6.1.2.  In  our  view  semantics  is  relative:  it  relates  two 
or  more  regular  structures  to  each  other.  Consider  therefore 
two  image  algebras 

’ '^1  = 

(6.1)  - 

^2  = <'‘2'R2" 


We  want  to  "explain"  in  terms  of  ' by  relating  images  from 

'2  to  some  in  To  distinguish  between  them,  let  us  speak  of 

^ as  the  primary  image  algebra  and  of  as  the  secondary  one. 

This  semantic  map,  sem ; ‘>2  * > defined  on  some  subset 

^2*^  /2 , shall  be  uniquely  defined.  Otherwise  our  "explanation" 

would  be  ambiguous.  This  is  something  we  have  decided  to  avoid; 

t 

see  section  2.4.  We  shall  then  say  that  sem  is  adequate  jF^or  ^2 
relative  to  /^ . 

The  inverse  of  sem  need  not  be  unique.  A given  primary  image  I 
can  correspond  to  a set  (with  several  elements) 

(6.2)  sem  ^ ( T ) c v 


(6.2) 
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Sometimes  it  is  better  to  start  the  analysis  of  a semantic 

-1  '^2 

scheme  via  this  inverse  map  sem  : ' 2 . When  the  secondary 

image  algebra  is  a language,  sem  ^(T)  consists  of  all  grammatical 
utterances  that  "mean"  I,  and  sem  ^ expresses  t h<'  linguistic 
^rategy  of  the  speaker. 

6.2.1.  In  this  paper  ve  shall  always  let  the  primary 
image  algebra  be  a relation  image  algebra,  as  discussed  in 
section  3.  The  secondary  image  algebra  shall  consist  of  a 
finite  state  language  L ( '<■  ) , viewed  as  a regular  structure; 
see  5.4. 

Since  we  have  card  ( ) = card(  , both  beinq  denumerably 

infinite,  there  is  of  course  no  problem  with  the  existence  of 
semantic  maps  adc'quatt'  for  rclativ^e  to  Indeed,  there 

always  exist  bijective  maps  ^2'  infinitely  many  of 

them . 

6.2.2.  The  trouble  is  that  a semantic  map,  even  though 
adequate,  even  bijective,  is  of  little  interest  unless  it  has 
additional  structure.  If  it  is  given  just  as  a list  of  pairs 
(l2fl^)f  l2*’  ^2'  ^1*^  ^1'  with  no  more  a prioristic  knowledge, 

it  could  not  possibly  bo  learnt  from  finite  experience,  nor  could 
it  be  remembered  using  a finite  memory. 

To  supply  this  missiiig  structure  we  shall  exploit  the 
combinatory  regularity  of  the  two  image  algebras. 


6.3.  Let  us  approach  this  topic  from  a trivial  example. 
.Say  that  consists  entirely  of  objects.  Then  any  image  in 
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is  just  a set  of  generators  each  of  which  has  out-arity  zero, 

so  that  they  cannot  bo  connected  to  each  other. 

To  describe  such  primary  images  it  suffices  to  introduce 

the  finite  state  language  with  = G^,  = {1,F}  and  all 

productions  of  the  form  1 '•  F or  1 1,  gt  G,.  This  language 

g 9 ^ 

* 

has  the  regular  expression  G^^. 

If  = g , g2  / • • ■ gj^  with  n(g)  occurrences  of  the  word  g, 
gt'G^,  then  the  semantic  map 

(6.3)  semd^)  = image  with  n(g)  generators  g,  g G G^ 

is  obviously  adequate.  The  inverse  sem  ^ ( I ) gives  us  all 
strings  over  G^  o ':  length  n with  n (g)  occurrences  of  g,  in 
arbitrary  order;  it  is  not  unique. 

d3.2.  A reader  is  certainly  entitled  to  object  to  this 
example  being  too  simple-minded:  real  semantics  is  infinitely 
more  complicated.  And  this  is  just  why  we  pic)<ed  the  example. 
As  soon  as  we  allow  connections  in  the  primary  image  alcubra, 
syntactic  constraints  will  be  forced  upon  us  in  order  to  make 
the  semantics  adequate. 

Consider  another  example,  still  quite  simple,  with  the 
generators  in  G^  given  in  Table  6.1.  An  arbitrary  imaqe  in 
then  consists  of,  say,  r u-generators  , to  m^^  ^ , m^  2 » • • • 
which  a ygsrisrator  connects  respectively,  in  addition  to  s 
l^-generators,  to  m2  ,m22  f • • ->1125  which  iS-generators  are 
attached;  see  Figure  6.1  where  r=3  ,mj^ ^^  = 1 ,mj^2"0  ,m^2“2  and 
s — 2 , m 21”^^  ^ 2 2 ^ * 
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A lanquage  suitable  to  describe  such  images  is  easy  to 
construct  and  we  exhibit  one  in  terms  of  the  wiring  diagram  of 
its  finite  automaton  in  Figure  6.2. 

This  language  will  now  be  supplied  with  a semantic  map  as 
follows.  Given  a grammatical  sentence,  for  each  time  we  pass 
the  branch  2 >•  3 we  add  a generator  a to  the  configuration 
diagram.  For  each  time  we  pass  the  branch  3 3 we  add  and 

connect  a generator  y to  the  last  a introduced.  Each  time  we 
pass  the  branch  4 5 we  add  a generator  P to  the  configuration, 

and  for  each  pass  through  5 ^ 5 we  add  and  connect  a generator  6 
to  the  last  p . For  other  branches  in  the  figure  we  do  not 
modify  the  configuration. 

This  defines  sem(T2),  uniquely  on  . It  is  also  clear  that 
sem  is  surjective.  Given  a primary  image  let  us  enumerate  its 
generatorsof  level  0,  first  the  a' s and  then  the  p's.  After  any 
occurrence  of  an  a we  put  the  y's  attached  to  it;  similarly  for 
the  B's  and  P's.  With  this  arrangement  pass  through  the  diagram 
in  Figure  6.2  writing  terminal  symbols  successively.  If  no  a 
is  present  in  I^,  we  go  to  4,  writing  a y;  otherwise  to  2 writing 
an  X,  and  then  to  3 writing  an  a.  If  the  a has  one  or  several 
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■ 's  attached,  loop  throuqh  3 3 the  same  number  of  times.  If 
any  more  t is  present  qo  back  to  2 and  so  on;  else  go  to  4 and 
India ve  in  the  same  way. 

This  will  produce  a qrammatical  sentence  T2,  I^tisem  ^(1^^). 

I’or  Fiuuri'  6.1,  for  example,  wo  cjet  the  sentence 

{6.4)  i T - xaqyav’aqqxbdddybx 

6.4^_1.  In  the  sentence  (6.4)  the  words  a,b,q,d  indicate, 

in  the  way  we  have  described,  the  occurrence  of  the  "related" 

qenerators  i,  The  other  words  x,y  play  a different  role, 

they  indicate  w)iat  connections  art'  established  between  the 

relat ions  (C ^ -qenerators ) . 

Often  we  shall  let  consist  of  two  disjoint  sets 

and  V . When  we  do  this,  each  qt  G,  shall  correspond  to  a 
conn  '1 

set  name(q) ' V . The  inverse  name  tells  us  which  qenerator 
name  

I name'  V represents.  The  words  in  V , the  conn-'ctives 

name  ^ conn  

I'lsed  in  a different  sense  from  ordinary  syntax),  are nee  led 

• 'j  ca rryinq  topoloqical  information. 

' .4.2.  It  should  be  unnect'ssary  to  warn  the  reader  that  this 
: t 't  supei'sed  to  model  natural  lanquaqt',  where  no  such  clear- 
:■  list  itK’t  ion  !n'tw('en  nanu's  and  connect  ivt's  can  be  made.  Our 
■ w IS  .•n'iicly  absttict,  an.l  speculative  rather  than  empirical. 
n.4.  1.  The  l.ic.t  .'xamplt'  bt  inas  out  what  is  the  essential 
diffii'tilty  in  esfablishinq  semantic  maps.  Finite  state  lanquage, 
consideti'd  as  a tt'qular  structure,  has  connection  type  T 2-  TINF.AR; 

Li  e 6.4.1.  Out  ri'lation  imaqe  a 1 qidua  on  the  other  hand  has  a 
I.  -h  -’inre  flexible  ('onru'ction  type  'h|  . 

_ _ . = 
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1 

Althouqh  we  shall  stay  with  finite  state  languages  we 
cannot  avoid  reminding  the  reader  that  with  context  free  languages 
Vv,'e  get  a more  powerful  topology,  namely  X = TREE;  see  Grenander 
(1176),  section  2.6.  Still  more  jjowerful  is  the  connection  type 
for  context-sensitive  languages  which  allows  cycles,  just  as 
in  our  primary  image  algebra.  This  should  be  looked  into  more 
carefully  in  our  future  work. 

6.5.1.  The  last  example  contains  a clue  f6r  the  under- 
standing of  semantic  maps  more  generally.  To  make  this  clear 
lot  us  return  to  the  wiring  diagram  in  Figure  6.2.  For  a given 
grammatical  sentence  I2  we  start  with  the  empty  configuration 
at  state  1.  If  the  first  word  in  T2  is  x we  go  to  2,  keeping 
the  empty  configuration.  If  the  next  word  in  I2  is  a,  then  we 
go  to  state  3 and  add  a to  the  empty  configuration.  If  the  next 
word  in  I2  is  g then  we  connect  the  generator  y to  the  generator 
in  our  monatomic  configuration.  We  now  have  a biatomic  configura- 
tion, this  is  processed,  and  we  continue  until  we  have  reached 
and  used  the  last  word  in  I2.  Then  we  have  a configuration  c 
from  ; the  corresponding  image  (c)  = sem ( 1 2 ) • 

This  is  a sequential  process,  mapping  configurations  in  y, 
into  others  in  the  same  space.  Which  configuration  map 
will  be  applied  during  each  step  of  the  process  depends  upon  what 
branch  we  are  passing  through  in  the  wiring  diagram. 

6.5.2.  This  leads  us  to  a concept  that  is  fundamental  for 
the  following  analysis. 

Definition  6.1.  By  a semantic  (finite-state)  processor  from 
^’2  — '"'1  ^ ^ m^an  a jjo  1 lectj  oii_oJ'  sets  wi  th 

^ 
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Cp=  Tj,  with  some  connectors  o^^(x):C.  • C ^ ; x(  , (where  o^j 
stands  for  a connector  that  may  or  may  not  contain  now  generators) 
and  the  processina  rules 

a)  We  start  at  state'  1 with  c = if 

b)  A sc'ntenct?  x^x^...x^^i  L ( <-  ) is  processed  lef  t-to-r  iejht 

c)  At  ary  transition  back  to  state  1 c is  made  equal  to  : 
again . 

Althouah  we  shall  study  only  finite'  state  language's  in  this 
paper,  the  definition  has  been  formulated  in  such  a way  that  it 
should  be  possible  to  adapt  it  for  more  powerful  lanauages. 

6.5.3.  To  gain  some  intuitive  understanding  of  the  role  of 
this  definition,  let  us  return  to  the  example  in  section  6.3. 
Introduce  the  subsets  of 


<■  1 


r 


^1  = 


C~  = configurations  with  r x's,  r • 0,  for  each  of 


which  may  be  attached  a number  of  ' s 
(6.5)  "S  = same  as  C2  except  that  r 1 


C4  - ^2 


= same  as  but  followed  by  at  least  one  3, 
all  the  B's  may  have  6's  attached 


V.  ‘"'1 


In  this  example  all  the  C. -classes  consist  of  reqular  r-j^-con- 
figurations,  but  this  need  not  always  be  true.  More  about  this 
later. 

The  associated  configuration  maps  given  by  c-onnectors 


. (x)  are  defined  if  i ‘ i is  a branch  in  ttie  diagram 
11  X 
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(6.6) 
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23 

. T 

33 


(a) 

(q) 


V 


45 

'55 


(b) 

(d) 


ai3(y)  = ■S_^(x)  = a^^iy)  = " ‘^44  " 

= '■'55  = identity 

add  unconnected  t to  conf iqurat ion 
connect  new  > to  last  i 
add  unconnected  r to  conf iqurat ion 
connect  new  (*>  to  last  6 


Remark  1.  Since  we  interpret  branchinq  back  to  state  1 as 
meaninq  "beqin  a new  (unconnected)  component  of  the  configuration 
to  be  calculated",  we  could  have  let,  for  example,  the  branch 
3 ^ 4 go  to  1 instead.  Remember  that  to  describe  unions  of 
unconnected  sub-configurations  we  need  no  syntactic  information 
in  addition  to  what  is  already  contained  in  the  sentence  to 
describe  the  sub-configurations. 

Remark  2.  In  the  successive  evolution  of  the  c's  we  may  have  to 
refer  to  qenerators  and  bonds,  which  will  be  done  in  terms  of 
the  con f iqurat ion  coordinates. 

Remark ^3.  The  processor  used  seems  to  be  related  to  the  concept  of 

tree  automata. 

J) . 1 . Given  a semantic  processor  (“'2  ' wo  can  <'Xtend 

the  conf  iqurat  ion  maps  Oj^^(x)  to  be  defined  for  phrases  u (in 

I- ( ''') ) by  puttinq  a_(u)  = undefined  if  u is  not  qrammatical, 

and  if  u is  the  qrammatical  phrase  (5.4)  with  i = i,i  = i, 

’ ^ o n 


(6.7) 


a . . (u)  = o . 

1 1 1- 


. (x  ) 
7 1 '■> 

n - 1 n 


. . ( <,, ) a . . (x , ) 

1,1  2 I 1 1 

1 o o 1 


Due  to  associativity  (6.7)  is  we  1 ! -dt'f  i ned , anil  since  is 
deterministic  t )ie  strinq  i^^,  i ^ , 1 , , . . . i is  uniipie  and  hence  also 


♦ , 


( ti . 7 ) . 'To  t !u'  omplv  ii  wt'  .issoc'iatr  = itlLMitity. 

i ) 

With  I 111'  I'x  I I'tuii'ii  Mt'in.inl  i <.'  map,  t ho  con  f i qurat  i on 


m.ip  ' j fopfosi 

'lit  s 

; oil!  S' 

I'ln.iMt 

i » ' 

ni.i  p 

Icif  c'cmfi 

qur.it  i ons  . 1 n 

■^2 

oon  t 1 1)11!  .1 ! i I'lis 

.ind 

1 im.iqo 

lU' 

1 vit'  , 

bu  t this 

i s usu.i  1 1 y not 

t ho  O.ISO  in 

1 • 

Wo  qot 

tv! 

t h. 

o im.iqo  .ilqobr 

.IS  .iftor  Rj- 

i don  t i t io.it  i on 

h.is 

; boon  1 

I 1 1 

oil  t 

i 11  v . 

(*'.  »)  • '^1  :som  ( I ,)  • Rj  |a  j |,  ( 1 p I . | 

I j 

(i . . ?.  Wi.'  ha'’o  obt  a i nod  t ho  somantio  map  bv  soquoiit  i a 1 1 y fi 

unwfapti  i iiii  f ho  moaiiina  ot  t lio  a i \'on  son  l oiu't.' . This  should  bo 

oomparod  with  t hi'  wav  Woqnof  ( i 'i(,H  ) v i ows  oxooutitiu  a 

oioipam  .IS  I ho  suooossivo  t t .ins  t orm.it  ion  of  infofm.it  ion 
stiuotut  i's.  In  t ho  pt  osi'iil  o.iso  t lu  inlotinat  ion  sti  uotutos  .ico 
oon  t' i ipir.i  t ions  t’l'om  ^ j.  At  o.ioh  stop  old  bonds  may  bo  oUi.sod 
and  now  qonoi  .itofs  bo  .iddod  . 'I'ho  out -bonds  of  t ho  now  qonot  ators 
m.iy  bo  lott  opon  on  bo  olosod  i mmod  i .i  t o 1 \’ . In  I ho  ox.implo  t ho 
I a t t (' t WM s t ho  O.ISO  . 

Tho  som.int  io  piooo.s.sor  still  iiu’olvos  cipof.it  ions  of  t cio 


i iionor.il  .1  n.ituio.  In  tho  noxt  soc't  ion  wo  sh.i  1 1 n.iffow  down  tho 

\ 

[ oho  I oo  1 11  f t hot  . 

I 


ii . 7 . boliHo  doinq  this  wo  montion  tho  followinq  siniplo  .ind 
oloii.uil  f osu  I t vith  i oh  sorvos  to  bt  i nq  out  moto  olo.uly  tho 
alqobraio  stiuolnio  ot  tho  problom  of  m.i  t liom.i  I i o.i  1 som.int  ios. 
Thoot  om  ti . 1.  Tho  oxtondod  som.int  lo  ptooossoi  loniis  .i  c'.itoqory. 
I’loof;  Intiodiioi-  tho  objools  (in  tho  toimiiioloqy  bolonqitiq  to 
o.itoqoi  iosl  r.  .ind  the'  ol  isso'-.,  possibly  ompt\',  ot  moiphisms 
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‘ c'  . 
1 


' K 


1 . . ( u ) ' u < V,,,) 

11 


I ! 1 < ■ 1 1 th.it  K . . con  t .1 1 till  t h('  i licn  t i t v man  C . ^ t . : ui 

11  • ' 1 1 ( . 

1 

■Pi'c  w.c  wc  li.iw'  cxlciuicd  t hi'  oriniiial  si'iiiantic  map  in 

A 

I 'i  • I i II 1 t 1 on  (> . 1 to  it  I o 1 I own  il  i roc  t I "i’  that 


t<'  . 1 0)  ' , (ii)  . (v)  a . , (uv)  t K . . 

I K K ' 1 ' 1 ' 


wlictc  MV  st.iiiiin  toi  the  coiu'.i  t ona  t i on  tif  the  striiiqs  u and  v. 
Hence  the  sem.int  ic  piocensot  loniin  a c.ifcMory. 


0 . H . n . 


i> . 7 . I . Considi,'!'  ,1  con  f i Mil  rat  i on  ci  . w i t ti  conti'iittc) 


(M  j , M , , ■ - • ) , sutMMciiptn  ate  the  cooniinales  of  the  Mi'iicr.i  t orn  , 

and  lioiuis  , k 1 , 7 , . . . n , i' = 1 , 2 , . . . m (m,  )*^1.  The  i n-boiul 

K t ")  1 1 1 K 

of  .inv  Mj.  has  tv'en  t epresen t I'l,!  by  .i  siiuila  vmIuo  of  l' , since 
t hi'  Values  and  striK'tiiral  (vi  tame  t e rs  of  in-bonds  (for  one  .tiiii 
the  same  ip'neiMtor)  h.ive  bi'en  assumed  to  be  the  Siinu'. 

het  u be  an  .irbitrary  Miamm.it  ic.il  fihr.tst.'  staitiiui  at  the 
sf.ite  i end  i iiM  at  i,  .ind  with  I lie  striiiM  ot  .irbiti.iiy  finite 

•k 

IciiMth  XjX,...  t When  we  .ipfdy  t lu'  cor  tes[>ond  i mi  I’onnector 

j(X|X,...)  to  c some  of  c's  bondf.  will  be  connecteii  and  the 

re.'it  wit  1 not  . benote  bv  T.  (c)  the  tablt'  of  the  bonds  bi'loiuiind 

1 

to  i'  th.it  c.in  be  connected  for  some  mi. mini. it  ic.il  pht.isc'  u st.irtinn 
at  1 . 

M.ich  entry  ol  T.(c)  will  consist  of  t hi  ec  j'.irts.  One  is  the 
liond  coordin.ite,  .mother  cons.isis  I'l  bond-structure  p.i  r.imet  I't  s , 
.ind  the  third  is  the  bond  v.iltic.  biiriiiM  the  si 'ipien  t i .i  1 piocess 


we  need  ('Illy  keep  in  memory  ci'iilent  (c)  and  T.{cl. 


t.  . 7 . . 


t.7 


t' . 7 . . 'I’lit'  iiuMuoiy  I'l'qu  i 1 1 'nuMi  t will  thfretoro  dt.'ponil  upon 

lu'w  l.uqt'  t lu'  i.ihlt's  I'c^ntont  (c’)  .iiui  T.  (c)  iiro.  'I’ht'  behavior 


ot  sleonttMit  (i'll  is  t'usy  to  f i ml . 
htMuma  t> . 1 . We  have  for  e’  = o.  .('irMe 

I I 

( t' . 1 I ) ei>n  t en  t (e  ' ) = conf  tMi  t (e ) U con  t en  t 1 e . ^ ^ u * ) 1 

'I'he  proof  is  imnu'diati',  since  connectors  can  only  add,  not 
delt'te  qi'ni' ra  t or s . 

'I’lu'  ii'latiiMi  (t'.ll)  implies  that 


(>'.  1.’)  MO  It  (c)  r Me.  . ( 'u  ')  ! . 

1 I 


'I'he  behavior  of  fht'  si/.e  of  'r.(e)  tiepends  on  the  (larticulLir 
semantic’  ma['  and  c’an  diffc'r  drasfically  f I'om  case  to  case  as 
will  b('  sc't'n  in  the'  nc'xt  sect  ion. 


t<8 


7.  Special  semant  ic  maj>s. 

7.1.1.  For  a (jivcn  primary  imaqe  alqebra  it  is  easy  to 
construct  a scheme  that  maps  any  reqular  conf iqurat ion  into  a 
finite  strinq  over  a finite  vocabulary,  in  sucti  a way  that  this 
strina  uniquely  determiiu's  the  con  f i qurat  i on  . 

We  shall  illustrate  how  this  is  dc^ne  via  the  imaqe  alqebra 
in  6.7.2.  Choose  as  consist  incj  of  the  symbols  n , h,  > , I'i , 1 , 1 1 . 
In  othi'r  words,  wt'  use  the  elenu'nts  in  t oqet  hei'  with  two 
dt'mari.'a  t i on  symbols  (.railed  1 atui  O . 

If  contetit(c)  (q  j , (1, , . . . (i|J  we  start  the  strirni  by 
q j (j  .^ . . . 1 I . If  t h('  first  out -bond  of  q|  qot's  to  q^  we 

concatenate'  the'  strimi  q ej^  . . . ej . [ . If  the'  ne'xt  e^ut-beind  epics 
to  c7  . we  concate'natt'  e|  ^ ej., . . . q . I , anel  sei  on.  Afte'r  the'  last 
eiut-beinel  of  q.^  we'  use'  the'  symbeil  O aeuiin,  t hen  con  t i luie'  with 
the'  eiut-bemds  in  q , and  so  on,  until  the'  e'ntire'  e'ein  f i (luiat  i on 
hiis  be'e'ii  e'xhaviste'd . Whe'n  ne’i  out-bonds  t'xist  nei  symbe'l  is  use'd 
be'twe'e'u  ele'e'u r re'tie'e'S  ot  Cl.  We'  do  neit  use'  I at  the'  e'lul  of  the' 
be'tuis  of  .1  (leiu'rator. 

'l'h('  e'euit  ieuiiat  ion  in  Fiuuti’  (> . 1 , lor  e'xample',  wi  1 1 be'  mappe'el 
i n t (1  t he'  st  r i lui 

(7.1)  a y a (>  y D O.,  n n n.oSaa  n<r  Ota  n □(«  r la  r > i n 

I 1 e > a . I > VC  r 1 ( \ I . < V > 1'  LI  LI  . 

The'  ele'e'evel  i nq  is  e’asy.  The'  substrinq  be'fevre'  the'  first  oce'ur  re'nce' 

of  [I  eiiv'e'S  us  e'e'iite'iit  (e')  . The'  substriiuis  be'twe'e'n  sue'e'e'ss  i ve' 


oce-u  r re'iice's  e'f  II  ej  i ve'  us  the'  enit-beinel  e'evnne'e't  i e'ns  of  e'ae'h 
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generator.  Roc.i  1 1 tfKit  the  out-arities  are  known  from  , so 
the  references  will  bo  unambiquous. 

7.1.2.  This  will  qive  us  very  lonq  strinqs,  even  for  simple 
conf iquraf ions , such  as  in  Fiqure  6.1. 

We  have  not  specified  the  syntax  of  the  lanquaqe.  The 

■k 

lanquaqe  is  certainly  not  the  entire  V^,  since  most  of  the 
elements  of  this  set  are  not  coded  representations  of  elements 
in  Instead  the  combinatory  reqularity  induces  syntactic 

constraints  for  the  coded  strinqs. 

We  mention  parenthetically  the  reason  why  we  had  te  rc’fer 
to  qenerators  by  strinqs  q^q2-..q-»  rather  than  just  by  q.. 

If  the  conf  iqurat  ion  to  be  talked  about  contains  two  itlentical 
qenerators  equal  to  q,  say,  the  latter  way  of  referrinq  to  them 
would  he  ambiquous.  In  Fiqure  7.1  the  imaue  in  (a)  clearly 
differs  from  the  one  in  (h) , althouqh  both  are  built  on  the  same 
qenerator  and  with  connection  c ‘ a,b  ‘ a.  To  specify  that  b 
be  bondf'd  *^o  a is  ambiquous  since  there  <ire  two  a's. 


(.1) 


(b) 


J 


Fiijure  7.1 
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This  is  not  always  the  case,  see  Figure  ’ Here  it  does 

not  matter  to  which  a-generator  we  connect  the  out-bond  of  b, 
since  will  identify  the  two  resulting  configurations. 

I f we  could  exclude  situations  like  the  one  in  Figure  7.1, 
we  would  make  our  task  to  construct  adequate  semantics  easier. 
That  would  be  to  avoid  a difficulty  that  seems  to  be  intrinsic 
to  the  whole  topic,  so  that  we  have  to  face  up  to  the  problem 
in  some  way. 


7.2.1.  Rather  than  pursuing  ad  hoc  schemes  as  in  (7.1), 
it  is  more  attractive  to  start  from  the  other  end,  with  a given 
semantic  map,  consider  its  memory  requirement  and  relate  this 
to  . We  shall  also  introduce  semantic  maps  with  special 
structure . 

De f init ion  7.1 . ^ semantic  map  is  called  backward  looking  if  any 

a^j(x)  connects  new  out-bonds  (if  any  at  all)  to  generators 
a_l  ready  i n c , c r C ^ . 
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Similarly  wc  could  spoak  of  forward  looking  semantic  maps, 
but  this  notion  will  not  bo  ntoro  than  mentioned  in  this  paper. 

7.2.2.  As  an  example  of  a backward  looking  semantic  map 
the  one  in  h . 3 can  bt'  mentioned.  The  only  connectors  o.  . (x) 
that  introduce  lU'w  gene*-ators  in  Figure  6.2  are 
'^^(a),  'j^lbl,  .',j.{d)  and  they  all  connect  the  new 

qenorators  to  old.  ones. 

Lenuna  7.1.  If  the  semantic^  map  is  backward  looking  we  have 
sem(*^u')t  f j for  any  grammatical  phrase  starting  at  state  1. 
Proof : Any  semantic  map,  in  the  sense  we  use  the  term, 

automatically  leads  to  local  regularity  for  sem(\i^).  Indeed, 

But  the  configurations  in 
C.  belong  to  so  that  all  closed  bonds  satisfy  . There- 

fore it  is  only  necessary  to  verify  global  regularity.  But  each 
connector  in  the  semantic  unwrapjiing  of  ^u'  either  does  not 
contain  any  generator,  or  i f it  does,  all  their  out-bonds  are 
connected  inrnied iatel y . Therefore  all  the  out-bonds  of  sem{^uM 
are  closed  and  holds. 


/I 

sem ( u ) i c j . 


Q.F.D. 

7.2_^3.  Any  <irammatical  phrast'  ^u'  now  means  a regular 
con  f i ejura  t i on  , an  important  l.icl  tti.it  will  t.icilitate  t lu' 
li'arning  of  the  sem.intics.  Ttie  nvison  for  tliis  is  tli.it,  given 
a st'iitence  x^X2...x^_^t  1.,  we  can  considi'r  each  initial  phrase 
u^  = XjX2...X|^,  starting  with  small  values  of  k,  .ind  attempt  to 
learn  the  meaning  of  each  new  br.inch  in  the  wiring  diagram. 
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This  makes  sense  only  if,  as  here,  each  is  meaningful  in  V , 

not  just  in  wliere  the  conf  i qurat  ions  do  not  always  make  sense 
to  the  observer. 

7.  i.l.  To  build  up  a semantic  category,  see  Theorem  6.1, 

we  must  construct  the  connectors  . (x) , but  so  far  we  have 

1 1 

only  seen  some  simple  t'xamoU's  of  liow  this  can  be  done. 

Tti  penetrate  our  [irobli'm  deepiq-  we  shall  use  the  concept  ot 

bonding  functioti  whicli  ma^^s  syntactic  inj^orm^at  iojn  (from  the 

sentence  in  i.,)  into  topolr^ica  l_i  nformation  (for  the  perceiv'ed 

configuration  in  We  believe  that  this  concept  will  be  of 

fundamental  importance  in  further  work  on  mathematical  semantics. 

We  first  qivt'  the  formal  dt^finition  of  a bonding  function, 

and  then  illustrate  its  use  by  examples. 

7.1.2.  With  B = B.  = the  set  of  bond  v^alues  (for  G,  ) 

1 n 1 

introduce  the  si't 

(7.2)  D = B t ' (It  • 10  t • (BxBxB)  I ...  = U L I nj*-  ' . . . 

and  a set  1 of  functions  defined  on  subsets  of  0.  Denote  by 

I D ( ; ) the  domain  of  such  a boncHng  function  , Diif)'  D. 

A bonding  function  will  always  be  associatt'd  with  a bi'iul 

value  2 b,  anil  we  shal  1 assume  that  for  iS  - (b,  ,b,, , . . .b  ) t D 

1 2 n n 

the  bonding  function  takes  valiu's  in  the  set 

I 

I 

' (7.  1)  A^(l')  = 1 i |b.  = B)  . 

The  purpose  of  the  bonding  function  is  to  select  one  of  the  bonds 
of  thi'  generators  introduced  that  have  the  in-bond  value  B.  The 
set  ' j,  ( ^ consist  of  all  the  integers  l,2,...n.  We  shall 

1 

I 




make  sure  that  no  problem  arises  from  the  possibility 
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= 4'  by  restrictinq  the  domain  D(4')  appropriately. 

7^.  3 . 3 . Recall  that  the  topoloqy  of  'h^-conf  iqurations 
typically  looks  as  Fiqure  3.3  with  the  qenerators  arranqed  in 
layers  of  increasinq  level  of  abstraction.  This  makes  it 
natural  to  attempt  to  orqanize  the  syntax  x-  and  the  syntactic 

map  s^  in  a similar  way.  Passinq  throuqh  the  wirinq  diaqram  j 

we  would  first  handle  the  objects,  level  0,  then  the  properties,  j 

level  1,  and  connect  them  to  the  obiects,  and  so  on.  The  | 

connections  will  be  established  by  bond i nq  functions  attached  ■ 

to  the  bianche's  of  the  wirinq  diaqram. 

t 

Say  that  we  have  a branch  i j that  whose  connector  functions  j 

X 

on  level  ^ this  branch  we  associate  at  most  one 

qenerator,  say  qt  0^,  and  with  (‘•1  ^ > the  out-bond  values 

being  S , as  well  as  u'  bondinq  function  ^ 4’ 4 . 

Here  : should  be  associated  with  the  botul  value  S . We  allow  the  j 

r r j 

degenerate  cases  when  a branch  is  associated  with  no  qeni'rator,  ^ 

only  bond  functions,  or  with  no  qeiie:atot  and  no  bond  function.  j 

Then  the  connector  . (xt  should  be  formed  bv  connecting  the 

1 ) ■ 1 
t h 

I"  out-bond  of  q to  qenerator  number  (''')  in  the  previous  level 

III 

»’-l.  The  vector  3 ( , S., , . . . describes  the  in-bo!id  values 

of  the  subcon  f i qurat  i OT1  consisting  cif  the  qenerators  of  level  (-1, 


enuiTK'ra  t cd 

i n 

t ht' 

ot  di 

'V  they  liavt'  been  qenerateti. 

In  ord(' 

' I 

t hat 

t h 1 ^ 

; make  stuttu'  wt'  must  ensui  e 

t tiat  3 i 

n (41 

wh i ch  will 

hi' 

tloni 

' i n 

i I'.e  ti'lltiwinq  bv  must  t icing 

thi'  si'b 

ect i on 

of  any  bondinq  function  by  wtiat  blanches  pii'Ctnk'  the  cut  vent 
branch  in  t lu'  wiring  diagtam. 


74 


7 . 4 . 1_.  To  make  the  above  more  intuitive  consider  the  imaqe 
aluebra  in  4.2  restricted  to  qenerators  of  levels  0 and  1. 
Choose  L with  , and  = I 1 , 2 , . . . 1 0 , 1 1 , F ) with 

the  wiring  diagram  in  Figure  7.3. 

To  create  a semantic  map  we  shall  use  the  bonding  functions 
given  in  Table  7.2  and  interpret  the  grammatical  productions 
according  to  Table  7.1. 

Consider  the  sentence 


(7.4) 

with  the  parsing 


(7.5) 


1 2,3,4  5„10,,F 


It  is  grammatical. 


Table  7 . 2 
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bond inq 
function 


i = 3,4,5,6,7 


0^ , i=8 ,9,10 


11 


definition  of 


add  unconnected  C 


add  unconnected  k 


add  f and  connect  b 
th 


out,i-2 


to  (i-2)  of  last  k 


12 


0.,  1=13,14,15,16 


add  g and  connect  b ^ 

, out,i-7 

to  ( i- 7 ) of  last  P 


add  h and  connect  to  last  t 


add  j and  connect  to  last  P 


add  i and  connect  b and 

out,l 

b to  last  two  C's  and 

out/ 

^out^3  ^out,4  to  last  two 

k ' s 
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To  unwr^.p  the  meanina  of  we  get  by  successively  applying 
the  connectors  formed  by  usinu  the  bonding  functions  in  the 
tables : 


1 2 
1 


12,3 
a 3 


1 2.3^4 
■«  P 0 


1 2_3^4  5 
t P 6 > 


1 2 3,4  5,,10 
t ^ Y B 


r 

i 

O! 

lo 

k. 

( 

D 

% 

;0” 

O 

0 

© 

0 

I 

The  last  transition  10  ^ F does  not  chanqe  the  imaae. 

B 

Now  a more  complicated  example  is 


(7.6)  ^2  ~ 

parsed  into 


(7.7) 


1 2.3.4  5 11  ’.^,4  5678  9,F 
a B 6 -y  Y a B B y a a a a B 


Applv'ing  the  same  unwrapping  procedure  we  see  that  sem(I.,i  = 
given  in  Figure  7.4. 


e U k k 


9-. 


Y\'\ 

O O O O 


Figure  7 ._4 


Remark  1.  The  connectors  used  in  the  cxamjdi*  h.iv=  w er;>perties 


that  we  will  meet  under  more  general  conditions.  Ka>h  bonding 


function  connects  all  out-bonds  (if  any  at  all)  of  new  generators 


to  in-bonds  of  old  generators;  the  resulting  semantic  map  is  back- 


wards looking. 


Remark 2.  Any  bonding  function  in  Table  7.2  is  defined  in 


terms  of  the  1^^,2^'^,...  of  the  last  in-bonds  with  a given 


vali:e.  This  may  not  be  immediately  obvious  since  Table  7.2 


appears  to  mention  certain  generators  rather  than  their  in-bonds. 


Referring  to  Table  4.1,  the  last  two  rows,  we  see  however  that 


thin  amounts  to  the  same  thing  in  the  present  example.  In 


other,  more  general  cases,  this  distinction  must  be  kept  in  mind. 


Such  bonding  functions,  depending  only  upon  the  order  in  which 


generators  and  bonds  have  been  introduced  will  be  said  to 


employ  ordered  reference. 


7.4.2.  Nr.w  return  to  th<'  wiriiui  diattram  in  Fiinire  7.1.  A 


state  can  be  identified  with  the  set  of  strings  u leading 
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from  1 to  i.  Aotuolly,  Norodo'r.  t hoort-m  tells  us  that  if  we 

★ 

use  as  statt's  t ht'  i.'oiui  i ueuoe  olasses  ovi'r  we  qet  the 
minimal  wirinq  (.liaqram. 

A semantic  map,  qiven  in  terms  of  such  bondinq  functions 
that  were  mentioned  in  the  last  two  remarks,  depends  crucially 
uptMi  the  numlH'rs 

(7.8)  N.(8)  = min#lq's  int  rod  act'd  by  any  'u^  with  8.^^(q)=8l, 

tU  B,i  t . 

In  (7.8)  the  minimum  is  taken  over  all  phrases  start iruj  in  1 
and  endinq  in  i. 


In  t)ur  t'xample  wc  havt' 


(.0 

0, 

al  1 

1’ 

( 7 . ‘1 ) ^ 

N, 

1 

(I) 

- 

(in 

- N , ( 1 1 1 ) 

N ( IV) 

- N.,  (V) 

- 0, 

N.,  (VI  ) 

1 . 

{ L) 

= ^2 

(ID 

= ( I 1 1 ) 

= N.,  (IV) 

= (V) 

= 0, 

N2  (VI  ) 

• is  can  bt'  vt'rified  tjointi  back  to  'I’ablc'  4.1,  fourth  column. 

Tht'  numbers  N ((t)  tell  us  how  much  topolotiical  information 
wt'  havi'  built  up  at  state'  i t'xpii'sst'd  in  tt'rms  of  a lower  bound 
tor  the  numbt'r  of  potential  in-bontis. 

7.4.  1.  A reliitt'd  si't  n't  numbt'rs  art'  tlu'  lays  \^,(>f)  t>f  a 
bonti  i tui  function  .f  t'mpltiyinci  oniert'tl  rt'ft'rt'nct'.s . It  mt'ans 

(7.10)  maxinumbt'r  o\  stt'ps  backwartis  of  i e f t'tt'nci's 

f f*  I'-v'a  1 ut's  t e>r  f ' 


1 n t he  exam('  1 1'  wi'  have 
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= = 0 

= i-2,  = 0;  i = 3,4,5,6,7 

= i - 7 , \ , ( ; . ) = 0 all  other  P ; i = 8 , 9 

p 1 

= 3,  V ^^10^  ~ ^ «.'>ther  P; 

The  laq  tells  us  how  far  back  wc  have  to  remember  potential 
in-boncls  of  qenerators  that  have  a 1 1'eady  been  unwrapped. 

7.5.  I.eavinq  the  example,  consider  now  the  connectors 
constructed  as  above.  Does  it  lead  to  a semantic  category  as 
in  Tlu'orem  6.1?  An  answt'r  is  giv'cn  by 

Theorem  7.1.  Consider  a backward  looking  strategy  and  assume 
that  for  any  branch  i j in  the  wi r i ng  diagram  any  assoc i a t ed 
bonding  function  if  wiH^  bond  value  P sat  isf  ies 

(7.12)  (iM  < N.  (p)  . 

Then  the  construction  leads  to  a semantic  category  and  range 
(sem)  , yj  . 

Proof:  We  const ruct  the  connectors  e.^(x)  directly  by  executing 

the  commaiuis  in  the  bondinq  func-tions  belonciing  to  the  branch 
' X ’■  time  we  have  zero  or  one  generator  whose 

out -bonds  have  t ci  bi'  I'l'intu'ct  <h1  . The  liondiini  functiotis  do  this 
without  ambiquity  s i nci  only  one  qenerator  is  coiicerned  as  far 
as  on  1 -li.  a ! ■ S'. 

Wi'h  » 'i.  1 : c ftif  Cl  iiin'cl  ors  we  can  now  build  up 

t (if  cl  ISO".  • , ■.*  u t I rii  wit'.i  the  emj't  y I’on  f i gu  ra  t i on  at  state  1 


(7.11)  I ^,,(7.) 


\ ( ^ ) 
VI  ^ ’ 10 


I- ; . 


t 


L 
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r 

I 

[ >iiui  connect  inq  moi'c  qeneratoi's  or  closiiu]  bonds  as  conuiianded  by 

the  o .(x).  We  have  to  make  sure  that  these  classes  are  subsets 
1 1 

of  c j ; see  Definition  6.1. 

This  is  so;  in  the  present  case  we  can  even  assert  that 

' ^l’  ^ conf  iqui'at  ions  that  we  unwrap  sequentially 

are  reqular.  As  for  qlobal  reqularity  this  follows  from  what 
was  said  in  the  proof  of  Lenma  7.1. 

Local  reqularity  does  not  follow  quite  as  diiectly.  Indeed,  it 
could  happen  when  wt^  buiKl  up  the  classes  that  the  valiu'  of  a 
connector,  when  applied  to  the  current  con f i qurat i on , is  not 
defined.  But  such  a connector  is  made  up  by  bondinq  functions, 
each  ; of  which  only  refers  backwards  a certain  number  of  steps 
in  the  order  of  reference.  If  fewer  cienerators  with  the  relevant 
in-bcmd  had  been  introduced  so  far  the  procedure  would  fail. 
Condition  (7.12)  insures  that  this  cannot  hap^'cn:  we  have  access 
to  the  required  number  of  relevant  in-bonds  in  our  list  of 
fHitetitial  ones.  Thc'refore  is  alw.iys  defined,  the  bond  can  be 
closed  without  v’iolatinq  q , and  the  lu'w  I'ont  iqurat  i on  will  be 
‘ ri'iuilar. 

0 . K . D . 

7.6.  It  is  obvious  }u>w  u forward  lookinq  st rategy  would  be 
orqani/.ed.  This  will  !iot  be  clone,  but  we  shall  have  occasion  to 
study  sttMteqii's  lookiiu]  both  forward,  for  some  bondinq  functions, 
and  backw.ird  for  othi’rs.  Theorem  7.1  will  then  have  to  be 


I 


mod  i f i t'd  . 
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Since  lags  can  then  be  both  positive  and  negative  we  also 
need  a function  qiven  as  the  maximum  of  the  absolute  value  of 
the  negative  lags  involved;  we  will  use  both  Xo{(J>)  as  before 

p 

and  t he  new  X (4')  • 

We  also  need  an  analogue  of  the  numbers  N^(B)  in  (7.8)  and 
i n troduce 


i P 

(7.13)  M^(t')  = min  #lg'  introduced  by  any  u wit 


i-'^j^(q)  = (<};  (^t  B,  j(  . 


There  will  now  be  two  conditions 


(7.14) 


Xp  (I-)  i N.  ((O 


Xp (^)  < M. (6) 


in  order  that  our  construction  yield  a semantic  category. 

Note  that  we  can  no  longer  assert  that  C^c  only  that 

CiC 

7.7.  What  wo  have  learnt  so  far  about  mathematical  semantics 
will  enable  us  to  approach  the  mathematical  study  of  learning 
semantics ; this  will  be  reported  in  a following  paper. 

It  is  clear,  however,  that  we  should  also  return  to  the 
questions  discussed  in  sections  G and  7 and  probe  deeper,  in 
order  to  get  a fuller  understanding  of  how  semantic  maps  work. 

In  particular  we  should  examine  under  what  conditions  sem  is 
adequate  for  the  entire  perceived  image  algebra:  when  is 
range  (sem)  = V.^?  We  do  not  yet  have  any  method  for  answering 
this  important  question. 
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8.  Conclusions . 

8.1.1.  Mathematical  semantics  in  the  sense  we  understand  it 
IS  relative:  it  refers  one  alqebraic  structure  .^2  > which  may 
be,  but  need  not  be,  a formal  lanquaqe,  to  another  structure 

8.1.2.  These  structures  are  exjiressed  in  terms  of  combinatory 
reqularity  in  the  pattern  theoretic  sensi'.  We  have  constructed 

an  imaae  alaebra  for  this  purpose  witii  relations  as  generators. 

8.1.3.  A semantic  map  attaches  to  each  grammatical  phrase 
(or  more  generally  image  in  V2 ) •'  morphi.sm  from  a category  (in 
the  alqc'braic  sense),  whose  objects  an'  configuration  sub-spaces 
in 

8.1.4.  The  morphisms  represent  connectors  that  are  given 
in  terms  of  bonding  functions  tl'.at  connect  bonds  of  generators 
belonging  to  respective  connectors. 

8.1.5.  We  have  given  sufficient  conditions  in  order  that  a 
finite  state  language  can  be  "explained"  by  a semantic  category 
relat ion  to  . 

8.2.1.  We  are  now  ready  to  proceed  to  the  next  phase  of  this 
study  in  which  we  will  bo  done  in  three  steps. 

8.2.2.  First,  we-  shall  implement  some  more  substantial 
instances  of  semantic  categories  on  the  computer.  The  purpose 
is  not  to  develop  large  software  systems  for  any  practical  use, 
but  to  increase  our  intuitive  underst and i mj  of  the  mathematical 
constructs  that  wo  have  introduced  in  the  present  paper.  Hand 
simulation  is  impractical,  if  at  .ill  possible,  of  the  regular 
structures  we  hope  to  deal  w i t h,  liecause  of  their  complexity. 
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The  resulting  programs  will  also  be  used  later  for  studying  the 
learning  of  semantics. 

8.2.3.  Second,  we  shall  investigate  how  semantic  categories 
can  be  learnt,  and  try  to  construct  incremental  learning  schemes 
involving  only  moderate  computational  effort. 

8.2.4.  We  shall  examine  in  greater  detail  the  mathematical 
properties  of  semantic  categories  and  their  maps.  In  particular 
we  want  to  determine  the  range  of  sem  and  find  conditions  for 

it  to  be  the  whole  We  shall  also  study  the  probabilistic 

aspects  of  , which  has  not  yet  been  done;  this  is  needed  for 
8.2.1,  in  addition  to  its  intrinsic  interest.  Functors  on 
semantic  categories  also  require  study,  for  example,  those 
that  correspond  to  generator  maps. 


f 

i 

t 
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I 

I 

i 


For  the  reader's  convenience  a selection  of  Wittgenstein's 

aphorisms  is  given  from  Tractatus  and  with  the  original 

number i ng . 

1.  The  world  is  everything  that  is  the  case. 

1.1  The  world  is  the  totality  of  facts,  not  of  things. 

1.11  The  world  is  determined  by  the  facts,  and  by  these 

being  all  the  facts. 

1.12  For  the  totality  of  facts  determines  both  what  is 
the  case,  and  also  all  that  is  not  the  case. 

1.2  The  world  divides  into  facts. 

7.01  An  atomic  fact  is  a combination  of  objects 

(entities,  things) . 

2.021  Objects  form  the  substance  of  the'  world.  Therefore 
they  cannot  be  compound. 

2.0272  The  conf iqurat ion  of  the  objects  forms  the  atomic  fact. 

2.03  In  the  atomic  fact  obiects  hang  one  in  another,  like 
the  links  of  a chain. 

2.032  The  way  in  which  obiects  hang  together  in  the  atomic 
fact  is  the  structure  of  the  atomic  fact. 

2.12  The  picture  is  a model  of  reality. 

2.13  To  the  objects  correspond  in  the  picture  the  elements 
of  the  f)icture. 

2.141  The  picture  is  a fact. 

2.16  That  the  elements  of  the  picture  are  combined  with 

one  another  in  a definite  way»  represents  that  the 


things  are  so  combined  with  one  another  . 
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2.21 

2.22 

2.221 
2 .222 

2.224 

3.14 


3.2 

3.201 

3.202 

3.20  1 


The  picture  aqrees  with  reality  or  not;  it  is  right 
or  wrong,  true  or  false. 

The  picture  i.  [presents  what  is  represents, 
independently  of  its  truth  or  falsehood,  through  the 
form  of  representation. 

What  the  picture  ret)resents  is  its  sense. 

In  the  agreement  or  disagreement  of  its  sense  with 
reality,  its  truth  or  falsity  consists. 

It  cannot  be  discovered  from  the  picture  alone 
whether  it  is  true  or  false. 

The  propositional  sign  consists  in  the  fact  that  its 
elements,  the  words,  are  combined  in  it  in  a 
definite  way. 

The  propositional  sign  is  a fact. 

In  propositions  thoughts  can  be  so  expressed  that  to 
the  objects  of  the  thoughts  correspond  the  elements 
of  the  propositional  sign. 

These  elements  I call  "simple  signs"  and  the  proposition 
"completely  analy?ed".  ' 

The  simple  signs  employed  in  propositions  are  called 
names . 

The  name  means  the  object.  The  object  is  its  meaning.  - 


3.21 


To  the  configuration  of  the  simple  signs  in  the 
propositional  sign  correspomte  the  configuration  of  the 
objects  in  the  state  of  affairs. 


1 
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3.22  In  the  proposition  the  name  represents  the  object. 

3.25  There  is  one  and  only  one  complete  analysis  of  the 
proposition . 

4.021  The  proposition  is  a picture  of  reality,  for  I 
know  the  state  of  affairs  presented  by  it,  if  I 
understand  the  proposition,  without  its  sense  having 
been  explained  to  me. 

4.026  The  meanings  of  the  simple  signs  (the  words)  must  be 
explained  to  us,  if  we  are  to  understand  them.  - 

4.0311  One  name  stands  for  one  thing,  and  another  for 


another  thing,  and  they  are  connected  together. 
And  so  the  whole,  like  a living  picture,  presents 
the  atomic  fact. 
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